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\m  itivcniiiry  model  in  which  future  demand  is  affected  hy  stockouts  has  heen  considered 
recently  hy  B.  I,.  Schwarl/..  Some  Kcneralizations  of  Schwartz's  minlel  are  presented  in  this 
paper  and  properties  of  the  optimal  policies  are  determined.  In  the  case  of  deterministic 
demand,  a set-up  cost  is  included  and  a mixture  of  harklonied  and  nonhackloKited  orders 
is  allowed  during;  stockout.  It  is  proyed  that  the  optimal  policy  entails  either  no  stockout  or 
continual  stockout,  dependinii  on  the  values  of  three  parameters.  For  stochastic  demand,  the 
effect  III  stuckouts  on  demand  density  is  postulated,  the  resultintt  optimal  inventory  policv 
is  discu«sed,  and  an  example  involving  an  exponential  density  function  is  then  analyzed  in 
detail. 

INTRODUCTION 

Optimal  inventory  policies  may  involve  stockouts,  even  when  the  demand  is  assumed  to  he  deter- 
ministic. The  effect  of  stockout  in  inventory  models  is  usually  taken  into  account  hy  means  of  a stock- 
out (penalty)  cost.  In  some  cases  this  may  he  appropriate,  e.g.  when  the  demand  during  stockout  is  met 
hy  a priority  shipment  or  extra  production  run.  In  other  cases,  however,  stockouts  may  cause  loss  of 
goodwill  and  affect  future  demand  to  the  firm.  B.  L.  Schwartz  1 1, 2|  formulated  a “perturhed  demand” 
model  to  analyze  this  latter  situation.  The  initial  results  of  Schwartz  are  extended  in  this  paper. 

The  case  of  uniform  demand  rate  is  considered  first.  Customer  response  to  stockout  is  assumed  to 
lower  future  demand,  and  the  steady  state  (long-term)  situation  is  analyzed.  If  there  is  no  restriction  on 
order  size  or  interorder  time,  it  is  proved  for  a generalization  of  Schwartz's  model  that  the  optimal 
policy  entails  either  no  stockout  or  continual  stockout.  For  problems  involving  fixed  order  size,  fixed 
initial  inventory  level,  or  fixed  interorder  time,  the  equations  for  the  optimal  policy  are  derived. 

In  the  case  of  stochastic  demand,  a form  for  the  future  demand  densiiy  as  a function  of  stockouts 
is  proposed.  Optimal  inventory  policy,  based  upon  this  assumed  form,  is  discussed  and  an  example 
involving  an  exponential  density  function  is  presented. 

DETERMINISTIC  DEMAND 

In  the  case  of  deterministic  demand,  consider  a firm  carrying  a commodity  for  which  the  potential 
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demand  rate  is  Xo  (measured  in  units  per  time).  That  is,  tiie  firm  would  experience  demand  rate  Xo 
if  none  of  its  customers  were  to  ever  confront  a stockout  situation.  Given  that  this  firm  institutes  an 
inventory  policy  resulting  in  a fraction  a of  demand  occurring  during  times  of  stockout,  one  would  ex- 
pect to  find  demand  perturbed  downward  from  Xo  to  a lesser  rate  X =/(a;  Xo)  as  a result  of  lost  customer 
g(M)dwill.  The  first  practical  formulation  of  this  “perturbed  demand"  concept  is  attributable  to  B.  L. 
Schwartz  [1,2]. 

In  short,  the  impficit  assumption  in  all  classical  inventory  formulations  is  that  demand  experienced 
by  an  individual  firm  is  insensitive  to  the  firm's  operating  policy.  The  firm  wishes  to  choose  a policy 
which  reflects  an  optimal  balancing  of  holding,  ordering,  salvage  and  penalty  costs.  Although  a cost  is 
generally  associated  with  stockout,  demand  is  considered  independent  of  the  frequency  of  such  occur- 
rences. Intuition,  however,  must  lead  one  to  question  this  assumption.  It  surely  seems  more  reasonable 
in  many  cases  that  the  loss  of  goodwill  which  accompanies  repeated  stockouts  will  indeed  be  manifest 
through  lowered  customer  demand. 

Consider  the  periodic  inventory  history  depicted  in  Figure  1 . Deb  very  of  an  order  of  size  Af  — (1  —b)L 
signals  the  start  of  a peri'id.  Inventory  depletion  occurs  at  the  constant  (steady  state)  rate  X per  unit 
time  until,  after  T units  of  time  have  elapsed,  a total  demand  of  M units  has  been  registered.  In  each 
cycle  L units  of  demand  are  recorded  while  stockout  conditions  prevail  and  it  is  assumed  that  hL  of 
this  unsatisfied  demand  may  be  backlogged  until  new  supplies  become  available  in  the  next  period, 
where  1.  Such  a situation  might  arise,  for  example,  if  some  customers  were  unwilling  to  wait  for 

the  next  shipment.  (The  classical  backlog  and  nonbacklog  cases  are  given  by  />=  1 and  /j==0.  respec- 
tively (3). ) Therefore,  loss  of  sales  per  period  totals  (1  — h]l..  Once  M units  have  been  demanded,  a new 
order  of  size  M — { \ —b)L  is  placed.  Delivery  is  assumed  to  be  immediate  and  all  backlogged  demand  is 
filled.  Present  inventory  level  now  equates  with  inventory  holdings  at  the  previous  period's  commence- 
ment and  the  cycle  repeats. 

Suppose  the  firm  wishes  to  maximize  average  profit  per  unit  time.  Considerable  simpbfication  re- 
sults from  observing  the  sufficiency  of  an  analysis  of  average  profit  per  unit  time  in  a single  cycle.  That 
such  a study  is  indeed  sufficient  follows  from  the  periodicity  of  the  inventory  history.  The  firm’s  quest 
reduces  then  to  the  single  period  problem  of  calculating  an  optimal  set  of  values  for  the  decision  vaiia- 
bles  M and  L. 

Note  that  periodicity  of  inventory  history  is  not  inconsistent  with  the  perturbed  demand  hypothesis 
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Figure  1.  Inventory  system  in  steady  state  with  deterministic  demand. 
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that  stockouts  in  one  period  will  influence  demand  in  future  periods.  Kor  once  the  firm  institute.^  a per- 
manent inventory  policy  ibv  choosing  fixed  values  of  .1/  and  /.I.  each  customer  will,  in  due  time,  ex- 
perience a series  id  satisfactions  and  disappointments.  The  system  achieves  eiptilihriuin  when  ordering: 
rates  have  heen  revised  in  accordance  with  the  hrm's  established  re<-ord  of  customer  service.  This 
study  focuses  upon  the  operating  characteristics  of  the  stahili/.ed  system. 

Kor  the  moment,  consider  .‘'chwart/'s  assumption  retrardinn  customer  response  to  stockout.  That 
is.  when  a customer’s  demand  cannot  he  immediatelv  vatisfi«‘d,  the  customer  reacts  to  this  disappoint- 
ment by  purchasinti  / less  units  in  the  future  than  he  would  otherwise  have  purchased.  Kor  each  unit 
of  stockout  the  firm  loses  / units  of  sales  over  the  infinite  future  hori/.on  .'schwart/.  has  su^pested  a 
method  for  evaluation  of  the  parameter  / 1 1 1. 

.Since  the  system  is  operalint;  i'l  eipiililiriiim.  the  future  effect  of  >|nckoul'  experienced  in  an\ 
sin(.'le  cycle  must  he  in  balance  w ith  the  aceiimiilaled  impact  nn  that  cycle  of  stockouts  em  ountered  in 
previous  periods,  riierefoie.  for  the  purpose  of  mathematical  formulation,  it  is  proper  lo  treat  the  L 
stockouts  in  any  period  as  ihoufili  they  afleci  the  demand  rate  for  that  period.  It  is  important  to  realize 
that  this  observation  i~  made  solely  in  ihe  interest  of  niatheinalical  simplicity.  It  is  not  a correct  descrip- 
tion of  the  actual  dvnamics  of  a system  operating’  under  perturbed  demand  assumptions. 

(oven  a poti-ntial  demand  of  with  no  stockouts.  K»T  represents  potential  demand  in  a period  of 
lenfith  7'.  .-Xctual  deiiiand  per  cycle.  bow*-ver,  eipials  A,,/'  - /,/  as  a result  of  / units  of  lost  sales  accruing' 
to  each  of  the  /,  disappoitltment^  per  I'ycle.  In  view  of  the  fact  that  total  demand  per  period  equals 
I/,  it  follows  that 
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W = A/  = A«/-/,/. 


or 
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rhis  relationship  provides  the  futidainenta!  link  betw<-»Mi  perturbed  and  potential  demand. 

Vi  e assutne  that  the  followinn  cost  and  revenue  factors  are  operating:.  A cost  (ler  unit  lime  is  associ- 
ated with  storin;:  each  unit  of  inveiilorv  held.  I'his  holding  cost  is  taken  to  be  lineai  with  coefheient  H. 
Orderintt  cost  has  two  components;  in  iiddilion  to  a proportional  cost  of  r per  unit  ordered,  a set-up 
cost  of  A is  levied  limb  pendent  of  ordei  si/el  foi  eae|i  onier  placed.  Kevenue  is  proportional  to  (|uantity 
sold  with  coeflicient  r.  Recall  that  no  immediate  penally  arises  from  stockouts  under  the  assumptions 
of  p»-rlurhed  demand.  I’enallies  from  stockout  are  reflected  in  the  lowered  future  demand  which  de- 
rives from  the  perturbed  demand  effect. 

Since,  in  every  period,  the  firm  -ells  the  same  quantity  as  it  orders,  it  is  convenient  lo  formulate 
the  problem  in  terms  of  net  revenue  per  unit,  didined  as  \ /— c.  Therefore  profit  per  cycle.  II.  may 
be  written  as 

[M  l.\~H 

Id)  1I  = [.V/-(I-M/-1V K. 
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Defining^  to  be  net  profit  per  unit  time,  it  now  follows  that 
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It  is  always  understood  that  ,V  > 0.  for  otherwise  the  problem  is  trivial.  But  ;V  > 0 implies  that  Va„  ^ 
0 so  that  in  finding  values  of  \f  and  /,  which  maximize  /'/.V\o.  one  has  found  those  values  of  M and  /, 
which  maximize  P.  Therefore  it  is  sufficient  to  consider  the  problem  of  maximizing /’/.VXci  with  respect  to 
Wand/,. 

Uefine 
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In  terms  of  these  nondimensional  quantities.  (4)  becomes 


l>  = 


_ (m  — ( 1 — A)/— / J 
^ {m  ^ II)  2m 
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The  decision  variables  are  / and  m.  and  the  relevant  parameters  have  been  reduced  to  k.  h,  and  / 

It  is  clear  that  ,W  and  L have  lieen  dehned  in  such  a way  that  W ^ /,  s 0.  whicit  immediatelv  lriltl^- 
lates  into  m ^ / sO.  Thus.  m = ()  implies  / = 0.  or.  in  other  words,  the  firm  is  experiencing  no  stockouts 
in  spite  of  the  fact  that  it  is  placing  no  orders.  This  circumstance  can  occur  only  in  the  degenerate  case 
of  A = 0.  Since  the  assumption  is  made  in  all  subsetjuent  formulations  that  A > 0.  it  is  onlv  necessary 
to  consider  maximization  over  m > 0. 

Note  that  if  A is  a fixed  constant,  then  lim  assumes  a fixed  ratio  y with  0 ^ y ^ I.  .\n  effective  ap- 
proach to  the  optimization  problem  consists  of  first  maximizing/'  along  rays  in  the  l/.  m)  plane  li.e., 
with  y fixed)  and  subsequently  maximizing  over  the  range  of  admissible  values  of  y.  For  / = yni.  writing/' 
in  terms  of  y and  m yields  the  function 


i7) 


[ 1 — ( 1 — /< ) y — ( / m ) ] ( 1 — y ) ^"1 

( I + y/ ) 2 


Differentiation  with  respect  to  m gives 
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dm  { 1 y/)m-  2 


^(1-y)^ 


and 
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a-p  -2k 


am-  ( 1 -)  yl)m^ 


Hence  p is  concave  with  respect  to  m,  and  for  fixed  y the  value  of  m which  maximizes  p is  obtained  as 
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< 1 y)  W 1 -f  -y/ 


l)y  x’ltinn  = !)•  Plols  of  m versus  y (or  parameter  valiif- / and  (al /.  = ().(X).S.  (Iii /.  = 0.2H12r). 

(»•)/,  “ 2.0  are  shown  in  Fijiure  2. 

Note  that  expression  ( 10)  for  m is  independent  of  /i.  For  a -ituation  in  whieli  y is  fixecl,  i lOi  (jives  the 
value  of  m which  maximizes  net  profit  per  unit  time.  The  fact  that  this  optimal  value  o(  m is  not  affected 
liv  changes  in  the  parameter  l>  lends  an  attractiveiies>  to  the  solution,  situ-e  a hrm  mav  he  uncertain 
about  the  actual  value  of  this  parameter. 

.'suhstilution  of  ni  = m from  ( lOl  into  i7)  leads  to  the  followiniJ  ex|)ression  f)  which  pves  the  optimal 
V alue  of /)  lor  fixed  y: 

illl  (T^/i  ~ ' /<)y-  ( 1 -yl  \ 2(  I - y/l/.  ]. 


The  maximum  over  all  rays  js  now  determined  tiy  lettiii(>  y vary  Irom  0 to  1.  The  derivative  il/iidy  can 
lie  written  in  the  form 


'Ip  ■ 1 ,,  lJ_y/U 

,ly  (1  *y/)'  ‘ ^ ^ ^ \ 2 


Its  si(:n  behavior  depends  only  upon  tlie  quantity  in  firackets.  which  is  an  increasinn  function  of  y; 
therefore  dpldy  is  eith*-r  alway.i  positive,  always  negative,  or  changes  sign  oni'c  from  negative  to 
(lositive  as  y ranges  from  0 to  I.  It  follows  that  the  maximum  ofp  occurs  at  one  (or  bothlof  the  bound- 
aries y = 0 or  y = I . In  Hgure  2.  /»  is  (dotted  versus y for  1 . / = 1.  and  lal  /.  = O.OO.S.  ibi  /.  = 0.2812.S. 
ic)  /.  = 2.0.  In  case  lal  y = 0 is  iqitimum.  in  ibl  both  y = 0 and  y = I give  the  same  i maximum  i value  ot  /i. 
and  in  icl  y = 1 is  ofitimum. 
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Kor  y = 0.  ( 1 1 f />  = I — V2/  and  (10)  yields  m — V 2k.  while  the  ease  y=  1 leads  to /»=/</(  1 •*  / ) 
and  m—  t x.  Hence  the  npiimal  pidicy  is  as  folhiws: 

it  1 — \ 2/  > 77.  then  m - \'2k  . 1 = 0: 

(!•(-/) 


if  I — \'2k  < j’yTTTy'  then  m = ! = '*■. 


In  other  words,  the  firm  either  should  never  he  out  of  sto<‘k  (/=())  or  should  always  he  out  of  stock 
(m  = /).  In  the  first  case,  note  that  the  optimal  order  quantity  is  |>ro|Hirtional  to  the  square  root  of  the 
storajje  cost.  File  second  case,  with  m = /=*,  is  of  course  not  a practical  result.  However,  other 
factors  or  constraints  may  compensate  for  this  inadeijuacy,  and  a few  will  now  he  considered. 

firm  may  w ish  to  restrict  the  rantte  of  y to  0 s y « y„  < I . The  arjiuments  above  again  lead  to  a 
boundary  solution,  and  the  optimal  jiolicy  results  from  a comparison  of  p at  y = 0 and  p at  y = yn.  The 
corresponding  value  of  m is  given  hy  (lOi,  and  l=ym. 

It  may  occur  that  the  nondirnensional  order  i]uantity  m is  fixed  at  some  value  rrin.  F’utting  m=  rrii, 
in  161  and  then  setting  </p/r// - 0 yields  the  cubic  e«|uation 

1 1 4 1 I "III  — / ) ( "111  - // )’  -^  k/m,i  — ll  ->  1 — /) ) "ijj  — 0 

in  the  parameter  /.  Comparison  of  the  net  proht  p at  the  real  solutions  of  il4l  in  the  range  0<  I < "in 
and  at  the  boundaries  1 = 0 and  I = rtin  leads  to  the  optimal  [xtlicy. 

.Suppose  the  firm  desires  that  the  inventory  level  at  the  start  of  each  cycle  be  a fixed  positive  value 
(J».  Then  "1=  / ' q where  q = QuH  Kn.\ . so  that  (6)  becomes 

hi  ^ q — k q^ 

(1  - /)/-  q ~ 2\l^q)' 

and  the  condition  i//Wr// = 0 impli(*s  that 

1 161  2(  /•(/  r*[  ( 1 -^  / M <7'[  I I / 1/  ~ 

This  qiiad''atic  c(|uation  in  / can  be  solved  immediately  and  the  optimal  policy  can  be  found  as  in  the 
previous  case. 

Finally,  the  interorder  time  may  be  prescribed  at  some  value  T=  Tn.  it  follows  from  (ll  and  l5l 
that  ni  = l — ll  where  l=T,tHl\.  -Substituting  for  m in  (6)  and  setting  dpid!=0  yields  the  (|uadratic 


equation 


2(/-t-  1 -/i)U  -//)’- r[/-(l  -/)/][ (2  Wli  - ( 1 -»  /)//]  = () 


and  the  optimal  policy  can  be  determined.  Ue  note  that  equations  (14).  (I61.  ami  (I7l  were  previously- 
given  (in  dimensional  formi  hy  -Schwartz  12)  for  the  case  K=0  with  //  = ()  and  /i  = 1. 

The  results  derived  above  are  bas»-d  on  the  relalionshi|i  (2)  between  perturbed  and  potential 
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demand.  Other  models  of  customer  resjMmse  are  (Mtssihle.  of  course;  for  example,  the  relationship 
might  he  assumed  to  have  the  form 


1 - [/.(/.»  »/] 


X = A,,  - ( 1:  ( /.  I M] 


where  /i(0l  = 0 and  fjlO)  =0.  If  h—  I and  if  the  hrst  derivatives  of  the  function*-  /|(/.I  and  /.-(/.)  are 
zero  at  /,  = 0,  we  note  that  is  positive  at  /.  = 0and  hence  the  optimal  jMilicy  alwavs  mvolve- 

stockouts.  The  case  /;(/.)  has  l»e<  n considered  in  |4)  to  miKfel  customer  res|»onse  when  litne 

of  stockout  is  a factor  as  well  as  the  amount  of  stoekout. 


STOCHASTIC  DEMAND 


4n  extensi  111  of  perturhed  demand  concepts  presented  so  far  is  now  sought  in  an  effort  to  analyze 
the  stochastic  demand  prohlem.  .Analogous  to  the  d«-terministic  demand  situation,  one  ma\  view 
long-term  customer  density  of  ilemand  as  a downward  perturbation  istemming  from  the  firm's  opera 
tiorial  inventory  |Hilicyi  of  potential  demand  density.  Tor  example,  allowing  inlerorder  time  to  vary. 
.Schwartz  |2.  4|  proposes  the  steady  state  perturlieil  demand  rate 


based  ujnin  hy|Kithetical  demand  rate  disap|Miintment  factor  a—  I.  W.  and  fixed  parameter  /. 

Here  we  will  investigate  the  case  of  fixed  interorder  time.  It  is  useful  to  formulate  this  problem 
in  terms  of  an  expected  disap(Miintment  factor.  Schwartz  |4|  considi-rs  a long-term  expected  disappoint 
ment  factor  a defined  bv 


where  d)„(^  I is  the  demand  density  in  steady  state  and  » is  the  stock  level  at  the  beginning  of  each 
period.  Ntite  that  0 « « =£  1 since  demand  density  functions  are  zero  when  their  arguments  are  nega- 
tive. As  an  example  for  </>„(£).  .Schwartz  gives 


(b.At  f = f I - (»/)<fi,p|  (I  (t/)f ) 


where  / is  a positive  constant  and  4)tA  ( ► is  the  density  of  demand  experienced  each  period  if  no  stock- 


I 


outs  ever  occur. 


,s 


<•  I < \1\F  \M)  K H IM  M l 


Ki|iialiiin  iLMi  i>  a funrlitiiial  r«■lall•lll^hi|>  iii  a Mhich  may  not  hast-  an  analytical  Milution  and 
licnrc  mas  liavc  to  lit-  »ol\cd  numerically  lor  ca<  h value  of  In  order  to  avoid  llii>  difhcultv.  we  deline 
tile  alternative  expected  di>ap|Miintment  factor  fi. 


r 


and  pro|Mi»e  that  the  lont’-terrn  demand  denMty  he  a function  i<(  fi.  Note  that  fi  i>  the  ratio  of 

exiK'cted  >tiK'kout>>  to  exjiected  demand.  ha>ed  on  the  deiiMty  d>«(^  I . and  that  0 ^ I.  AI>o.  we 
a»»ume  that  the  relation>hip  of  to<f^ll^l  ha^  the  form 


where  i.',,  i-  a lunction  o|  (i  The  rei|uiremenl 


■2.-)  I 


( <i>« 
J« 


I 


I'  aiitomatii  allv  sativhed  with  the  fortii  i24l. 

The  expectation  a«MK'ialed  with  dio  >atishe» 


1 2h  I 


Aid»;()  I ((biiifuli-  j 

Jll  Ml 


Uli  - I — ~ /■-l(f>iil 


and.  'ince  <<to('kout>  are  a>>umed  to  lower  future  demand,  we  mu«t  have 


'-'.I 


^ 1 • 


M'o.  -mce  (t>i\  i>  the  di>lrihution  when  there  are  no  >tockoiit».  i.e..  when  fi  -•  (•  . we  des-ire  that 


1 28 1 


a:,,  -»  I a>  /i  -»  O ' . 


We  a^^ume  that  i^  monotonically  increasinAi  a>  ^ increa>es  from  /.ero. 

One  mi^ht  also  assume  that  the  lonti-term  demand  for  the  tiriii's  product  tends  to  zero  if  a stock 
out  situation  (v  = 0)  always  exists,  iThis  is  especially  true  in  the  nonliacklo^:  situation.  i In  this  case 
one  would  require 


I 20  I 


H.I  ■ 


as  /i  I 


>ome  liinctions  satisfying;  conditions  l27l-(20)  are 
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A’.i  = 


1 

( 1 -/il 


( I ^ V rfi'  Y 0 


• il  I 


A'.i  = 1 - 7-7.  • '/  > ()■ 

Inli 


Il  llu-  inixlcl  i'  lo  It*-  >ucli  that  a >mall  amnunt  nf  -ttockoul  ilx-low  a threshold /3  = /3o ) has  no  effect  on 
lotif;  term  ilemand,  one  mi(iht  ast-nin«-  a lorm  >ueh  a- 


I .!:>  I 


A’ a 


1 forO^/a=s/3» 

Art  tor  fiu<  p<  1 


w here  i>  niven  li\  i.'iOl  itr  (,'li  1.  say.  with  ji  repla*-ed  hy 


i.VI) 


The  relation 


I - 


i.Ul 


Art=i-/a/.  />o. 


analogous  to  that  used  in  i22l.  satislies  conditions  l27l  and  i28l  hut  not  (29). 
\s  an  example,  consider  the  exjionential  density 


I .kS  I 


d>,AO=iie  <1  >0.  ( ^ 0. 


riteti  (f>rt(f>it>  also  an  exponential  density  with  parameter  find.  If  Art  i*  given  by  (.31).  one  obtains 

d 


..(hi 


/j  = e 


d 

1 4 — . 

ay 


d>rt  ( s 1 ~ “ j ‘ 


\ lusher  \alu*-ol  (/  implies  a larger  effect  of  stockouts  on  lotiA-lerm  demand. 

In  order  to  ilelermine  the  optimal  inventory  policy  ol  the  firm,  consider  a period  in  tbe  steady  state. 
1 sitie  the  classical  theory  for  now  |.3|.  let  <i)\()  he  the  density  function  of  demand,  x the  inventor, 
level  before  ordering  lit  .1  • 0,  then  — r denotes  the  amount  of  backlogged  orders),  and  y the  inventory 
level  after  ordering  an  amount  ; (so  that  \ — x = z.  ) ^ i ).  The  purchase  or  ordering  cost  is  assumed 
to  be  r(y  — t).  the  sale  price  lor  a unit  of  stock  is  r.  the  holding  cost  is  /i(y  — £)  and  the  stockout 
(penally)  cost  is  p(f  — y)+.  where  the  functions  c.  h.  and  />  are  zero  for  nonpositive  arguments.  For 
a given  demand  c,  the  total  loss  experienced  during  the  period  inav  then  be  expresseo  as 

tlir  frartional  part  1^  — >(/i  nl  t-xress  (IrmaiHt  niav  lx*  lia  Mo^f:«‘it.  lIx-n/Mv  ~ >(  niij:)il  lx*  assunif-H  to  havr  llx'  turm 
P(f  - > ) = Pi((f  - V K'l  ' li  - >)(  1 /il  |. 


(37)  I.(y:  x) - 


J (,AI\K  \M)  H II,  I’l.Al  I 


~ 0 + [niin(0.  I y 1/  [inin(^,..  > ) ]r  • /i(  \ ) ^ />(6  - y)  i(  V ^ 


f(.\  - X ) — (,\  - t)r  - /)((,  - > ] 


il  y < 0 


and  I lie  expected  Inss  is 


(38)  £[/.(y:x)]  = 


r(y  — x)  + [win(0,  x)]r  + f [/i(y  — ()  — r(  }t/f  t f [p(i  — y)  — n 

J It  Jii 

c{y  — x)  — (y  — .v)r  + j f>(f  — } ) <t>i( 

7 II 


if  V ? 0 


if  Y < 0. 


For  the  situation  considered  in  this  paper,  the  eileet  of  stockout  is  manifest  in  the  density  func- 
tion. In  (38),  therefore,  the  stockout  cost  is  ileletcd  and  the  density  <h(f ) is  replaced  hy  </>a(^)  which 
depends  on  initial  inventory  level  y . This  yields 


(c(  V — xl -1  [min  (0.  x)]r-r  j | d>n(<f)(/^  if  v 5 i 

J»  Jv 

e(y— x)  - (y-x)r  if  y < ( 

if  the  ordenng  cost  is  linear,  i.e.. 


then  (39)  may  he  written  as 


where 


r(z)  = z<\ 


(y  ; X ) ] = — e.v  ‘ [min  (0.  x ) ]r  fi't  \ ) 


f,'(  V I = r\  r /•'(  1 ), 


[/i(v-^)-r^|d),d^)r/^-rv  (f),i(^)«/£  ifv^O 

c ( y ) — • Jo  Jk 

-rv  if  > < 0. 


Now  consider  the  exponential  density  given  in  i36).  If  we  assume  that  the  holding  cost  is 

linear,  i.e.. 


and  define  the  nondimensional  quantities 


then  (42)  yields 


(45) 


(l-r)y 


if  y > 0 
if  y < 0. 


Note  that  ^(0)  =0,  as  intuition  would  supp<  One  ean  show  that  f7''(y)  > 0 for  y ^ 0,  and  lienee 
C(y ) is  convex.  In  F'igure  3,  plots  of  C ( y ) are  iiiven  for  parameter  values  f = 2.0.  h = 0.2,  and  d = 0.1. 
0.5,  1.0.  and  2.0.  The  minimum  values  of  C ( y ) occur  at  Vn,in  = 0.567.  0.405,  0. 178.  and  0,  respectively, 
and  y=  ymin  is  optimum.  The  long-term  density  functions  corresponding  to  the  optimal  policy  for  the 


1- 


-0  5>- 

Kuil'RE  3.  Hfhavior  <•!  G for  2.0,  h — 0.2.  lormulatiun. 


cases  ^/=  0. 1 , 0.5.  and  1.0  are  shown  in  Figure  4.  along  with  the  hypothetical  density  function  diul  ^ ) for 
d=0. 

Differentia  ing  (45).  one  obtains 


(46) 


(f+h) 

lim  C'( v)  = I + h — ( 1 — e 

T •u-  d 


which  is  positive  for  sufficiently  large  values  of  </.  Therefore,  if  the  effect  of  stockouts  on  long-term 
demand  is  large,  then  .Vmin  = 0 according  to  this  model  and  the  best  policy  may  be  to  not  carry  the  item 
under  consideration. 


Recall  that  the  disappointment  factcr/S  defined  in  (23)  is  based  on  the  density  d>o(^  ).  The  particu- 
lar example  treated  above  has  been  chosen  such  that  one  can  also  obtain  analytical  expressions  with  the 
use  of  the  disappointment  factor  a defined  in  (21 ).  If  we  replace  B by  a in  eijuations  (24)  and  (31 ) and 
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C(y)  = 


{r  -t  h) 

{\+h)\-- — -{!-<>  I'  '"‘■ilF}  ifv^O 

[1  — {dllna)  1 


(1  -ny 


if  y < 0 


which  is  plotted  in  Figure  5 for  the  same  parameter  values  as  in  Figure  3.  The  minimum  values  ol 
(5(y)  occur  at  ymi„  = 0.566  . 0.437  , 0.338,  and  0.233  for  (/=0.1.  0..3,  1.0.  and  2.0,  respectively.  .\ll 
curves  have  the  same  slope  ( 1 — r)  at  y=  0,  so  that  y^in  > 0 unless  the  unit  purchase  cost  exceeds  the 
unit  sale  price.  The  optimal  policy  is  again  y=  ymin- 

Comparing  Figures  3 and  5,  we  see  that  the  curves  C{y)  are  similar  for  the  two  formulations  if  the 
parameter  <l  is  small.  In  other  words,  the  formulation  in  terms  of  (3  and  the  one  based  on  a lead  to  similar 
optimal  inventory  policies  if  the  effect  of  stockouts  on  demand  is  not  too  large. '.\s  this  effect  increases, 
however, ymin  becomes  zero  in  the/3  mcrdel  hut  remains  positive  in  the«  formulation. 
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ABSTRACT 

A well  kn<iwn  preventive  replacement  policy  is  the  block  replacement  polic\  jBRP). 
Ill  such  a p<dicy  tfie  item  undergoes  a planned  replaec^nient  at  a sequence  of  equally  spaced 
time  points  independent  of  failure  history.  The  main  ad\antage  ot  a BKP  is  its  simplicit>. 
because  under  tliis  policy  it  is  unnecessary  to  keep  detailed  reci>rds  about  tinw's  of  failures 
or  ages  of  items.  The  main  drawback  of  a BRI*  is  that  at  planned  replacement  times  we  may 
be  replacing  practically  new  items.  In  this  paper  we  study  a modibed  HRP  which  tree  of  this 
drawback.  e calculate  the  expected  cost  of  folbiwing  a mi»dilied  BKP  for  bf<‘time  distribu- 
tions possessing  a special  structure  and  illustrate  it  for  the  case  of  an  Erlang  distribution. 
A numerical  comparison  is  made  between  a nuKlibed  BRP  and  a standard  BKP  for  ilie  special 
case  of  a two  stage  Erlang  distribution. 


1.  INTRODUCTION 

A preventive  replacemei.t  policy  may  be  worthwhile  in  reduoinft  the  cost  ol Dperating  a stochasti- 
cally failing  item.  Under  such  licy  the  item  is  replaced  before  actual  failure  (and  thus  we  lose  the 
value  of  any  remaining  life)  in  order  to  p =•  .t  the  extra  costs  associated  with  a failure. 

A well  known  preventive  r>  olaceo  eiii  <>licy  is  the  block  replacement  policy  (BRP).  In  such  a 
policy  the  item  undergoes  a p's.  i>  - ^lacem  nt  at  a sequence  of  equally  spaced  time  points  indepen- 
dent of  failure  history.  If  tin  s • thft  one  item  the  planned  replacement  times  arc  common  for 
all  of  them.  This  is  why  the  na  bixk  leplacement  is  used.  The  basic  BRP  model  is  presented  in 
[1:  pp.  95-%|.  A working  item  v ' failure  is  assumed  to  he  immediately  delectable,  is  replaced 
both  at  failure  and  at  fixed  inlerva’  of  i.me.  The  replacement  is  assumed  to  he  instantaneous.  The 
main  advantage  of  this  policy  lies  in  its  simplicity  because  no  recording  of  times  of  failure  and  ages  of 
items  is  requir  d.  The  objective  function  to  he  minimized  is  the  minimum  average  cost  per  unit  of  time, 
for  an  infinite  lime  horizon. 

The  main  drawback  of  the  BRP  is  that  at  planned  replacement  times  we  might  replace  practically 
new  items.  The  following  articles  modify  the  BRP  in  various  ways.  In  the  first  model.  [1:  pp.  96-  98], 
[2] . a failed  unit  is  no  longer  replaced  hut  is  instead  given  a minimal  repair.  By  minimal  repair,  we  mean 
that  the  repair,  needed  to  put  the  failed  item  back  into  operation,  has  no  effect  on  its  remaining  life- 
time. This  repair  action  is  mathematically  equivalent  to  replacing  the  failed  item  by  another  working 
item  of  the  same  age.  This  policy  may  be  appropriate  for  complex  systems  because  a system  undergoing 
minimal  repair  can  he  thought  of  as  a single  unit  which  is  aging  over  time.  Bhat  [3]  also  relaxes  the 
requirement  in  the  basic  BRP  of  replacing  failed  items  by  new  items.  In  his  model  failed  items  are 
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replaced  1)V  items  having  age  t (the  block  replacement  interval),  which  were  taken  out  unfailed  in  a 
former  planned  block  replacement.  By  reusing  these  items  unused  item  lifetime  is  reduced. 

In  a block  replacement  model  considered  by  Cox  [.S].  an  item  which  fails  “close  to"  the  time  of  the 
scheduled  block  replacement  is  not  replaced  and  remains  idle  until  block  replacement  occurs.  A 
penalty,  assumed  to  he  a linear  function  of  idle  time,  is  taken  into  account.  Crookes  [6]  in  one  of  his 
mi>dels  (strategy  E)  follows  similar  lines.  In  his  model  a unit  which  fails  at  any  time  within  the  interval 
is  not  replaced  until  the  next  block  replacement.  Both  of  these  articles  contain  a mathematical  error 
which  has  been  corrected  by  Blanning  [4].  \^  <>odman  [8]  suggested  the  use  of  dynamic  pntgramming 
to  find  tne  optimal  policy  for  the  preceding  two  models. 

In  this  paper  we  present  a different  modification  of  the  basic  BRP.  We  call  this  policy  a modified 
BRP. 

2.  OlJTLI>E  OF  A MODIFIED  BRP 

The  expected  cost  per  unit  time  per  item  of  a standard  BRP  taken  over  the  indefinitely  long  future  is 


(I) 


CU)  = 


+ r. 


where  t is  the  length  of  the  interval  between  scheduled  replacements,  .W{/)  is  the  expected  number  of 
failures  (unscheduled  replacements  in  [0.  f ) ).  M (t)  is  of  course  the  renewal  function.  C|  is  the  cost  of 
making  an  unscheduled  replacement  of  a failed  item.  r>  is  the  cost  per  item  of  a scheduled  (block) 
replacement. 

We  assume  that  r<  <r,.  and  that  the  conditional  probability  of  an  item  failing  in  the  interval 
(r.  .v+  A)  given  that  it  has  attained  age  r is  increasing  in  x.  This  property  is  called  IKR  (Increasing 
f ailure  Rate).  Mathematically  this  means  that  the  item  failure  rate  (or  hazard  rate)  r(t)  is  increasing 
in  X.  where 


r(.v)=7r . 

E(x) 


f(x)  and  F[x)  are  respectively  the  p.d.f.  and  c.d.f.  of  the  life  length  of  an  item  and  E[x)  = I — Fix). 

The  principal  advantage  of  a BRP  is  its  simplicity  since  it  renders  it  unnecessary  to  keep  detailed 
records  ahr)ut  times  of  failures  or  ages  of  items.  The  principal  disadvantage  of  this  policy  is  its  waste- 
fulness because  we  may  replace  practically  new  items  at  the  prescribed  replacement  points.  This  led 
us  to  consider  a modified  BRP  which  is  free  of  this  defect. 

In  the  modified  BRP  we  still  replace  failed  items  instantaneously  after  failure,  hut  items  possessing 
age  b or  less  at  scheduled  block  replacement  points  f.  2/,  .'ft,  . . . are  not  replaced  by  new  items  hut 
are  instead  permitted  to  remain  in  service:  b is  a number  between  0 and  /.  Thus  at  the  points  r ,2t' . 

. . . .,  some  of  the  items  will  have  age  zero  (0)  (following  age  replacement)  and  some  of  the  items 
wMl  have  age  jr,  0 < ,r  ^ b.  We  would  like  to  stress  that  the  time  points  I.  2t,  ....  are  no  longer 

regeneration  points  as  in  the  ordinary  BRF’.  This  makes  the  mathematical  treatment  much  more  com- 
plicated and  hence  nr  w techniques  have  to  be  developed.  The  age  distribution  in  the  stationary  case  is 
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denoted  by  the  function/(  j) , which  has  a discrete  point  mass  for  items  having  age  zero  and  is  otherwise 
continuous  for  age  x in  the  interval  Q < x ^ h.  Of  course 

(3)  [ f(x)t/x+/(0)  = 1. 


For  a modified  BRP  with  parameters  (/j,  / ),  the  expected  cost  per  unit  time  per  item  taken  over  the 
indefinitely  long  future,  is 


C(i,  t)  = 


ciEA^AOl  + c-iftO) 


where  Wx(0  is  the  expected  number  of  unscheduled  replacements  in  an  interval  of  length  t,  if  the  item 
is  of  age  X at  the  start  of  the  interval.  Of  course  Afolt)  = ^(0-  is  the  expected  number  of 

unscheduled  replacements  in  an  interval  of  length  t in  the  stationary  case.  That  is 


^x[.Wx(/)]=  f 
Jo* 


f{x)MsU)dx+f(0)M(t) 


We  are  interested  in  finding  the  values  of  b and  t which  minimize  C(6,  t).  To  do  this  we  must  find 
Es[Mx{t)]  and 7(0). 

Mj{t)  satisfies  the  modified  renewal  equation 
(fi)  <Wx(f)  = f’j-iO  + f M{t  — u)fAu)du, 


where 


FAt)  = 


F{x  + t)-F(x) 


Fo(t)  = F(t). 

Fx(t)  is  the  (conditional)  probability  that  an  item  having  survived  to  age  x will  fail  to  survive  for  an 
additional  length  of  time  t.  fi(t)  = (djdt)F r{t)  is  the  (conditional)  p.d.f.  of  the  additional  life  time  t of 
items  which  have  survived  to  age  x.fo(t)  = f(t). 

M(t)  is  obtained  by  solving  the  renewal  equation 


(8)  ^^(t)  = F(^)+|  M(t  — u)f{u)du. 

Jo 

(This  is  a special  case  of  (6)forx  = 0). 

f(x)  and /(O)  can  be  expressed  as  the  unknowns  in  the  following  Markovian  integral  equations 


r'jfcv' 
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fU) 


= f /(y)f 

JO* 


(9) 


f. 


>„x</v  + /(0)p„j.,  0 < X ^ 


/(x)Jx+/(0)=  1. 


where:  p^x,  0 < j:  ^ 0 ^ y ^ i is  the  stationary  Markovian  transition  probability  density  that  an  item 

has  age  x at  the  beginning  of  an  interval  given  that  the  item  had  age  y at  the  beginning  of  the  preceding 
interval. 

It  can  he  verified  easily  that 


(10) 


where 


l>us=  niyil  — x)F{x).  i)  ^ y ^ I).  0 < X ^ I) 


= m{t). 

Differentiating  (6)  yields  the  integral  equation 


(11) 


myU)=fy(l)  + 


[ /l/<“ 

Jo 


)m(t  — u)du. 


We  see  from  equation  (4)  that  the  computation  of  the  cost  functions  C(/>,  i)  requires  knowledge  of 
both  fxl'Wxff ) ) and/(0). 

To  find  them  we  must  know /(j:)(0  < a « b),  which  satisfies  the  integral  equation  (9).  To  obtain  a 
general  solution  for  this  integral  equation  is  difficult.  In  the  next  section  we  solve f{x)  for  the  case  when 
the  item  life  density, /(x),  has  a specific  structure. 

Having  sketched  the  modified  BRP  it  is  worthwhile  to  note  that  this  policy  is  similar  to  an  optional 
policy  with  regular  interopportunity  replacement  intervals,  discussed  by  Woodman  in  [7].  In  the 
optional  policy,  t is  a given  number.  In  our  model,  t is  a parameter  subject  to  optimization.  Woodman, 
using  a dynamic  programming  technique,  presents  only  the  basic  functional  equations  and  then  solves 
them  for  a specific  life  distribution  and  specific  parameter  values.  No  attempt  is  made  in  [7]  to  derive 
an  analytical  solution  which  gives  the  cost  of  a modified  as  a function  of  the  cost  parameters  and 
the  item  lifetime  distribution. 

3.  CALCULATION  OF  C(b,  t) 

Assume  that  fit  + y)  can  be  expressed  as 
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(12) 


Then  it  is  easy  to  verify  that 


/((  + y)  = ^ ai(/)^i(y). 


where 


and 


«i 


m„(/)  = ^ «i(/)^dy). 

(,)  = 5^(,)+f  ai(u)m{t-u)du,  i=1.2 A. 

Jo 

A(y) 


^i(y) 


F(y) 


Henc  e,  using  (10), 


(13) 


where 


Pu-r 


= 5;  adx)^/(y).  0«y«/c  0<x^b 


ai(x)  = aiU-x)F(x). 


Inserting  (13)  into  (>^)  yields 

(14)  /(x)='^ai{x)  [{.  f{y)fti(y)dY  + /{0)/3A0)  j. 


0<x^  b. 


Hence 


(15) 


/(x)  = 2 ccjaj(jr)- 


To  find  aj((  = 1 A)  we  insert  (15)  into  (14) 

(16)  2 i [ L jt  ]• 


L o;  • . f « ,r)(i=  1 A)  on  both  sides  of  equation  (16)  yields  the 

Equating  the  coefficients  of  ait*)(i  l,  • • ••  t 

a,  = y aj  f aj(yWy)dy +A0W0),  i = 1 

;=1  Jo+ 


equations 

(17) 


set  of 
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Kecallin^  that  /(O) 


(18) 


/( « )(/.i  w«‘  obtain 


'■  f" 

/(())=  1 — ^ (I,  I (» , ( \ ) (lx , 

j = I ■'  11  • 

Insfrtinp  ( 18)  into  (17)  yields  the  set  of  eiiuations  for  (/  = I 

k r r'' 

S "/  I «- 

J - I L J 0 • 


/ 1 


(19) 


<i,  = fiA0)  ) 5!"<[  f «,<>)(/i.(v) -/i, (()))(/) 


For  example  for  k = 1 we  get 


(20) 


I.et  us  now  define  a matrix  E 


<h 


)3,(0) 


-f 

J 0 • 


1-  a,(.v)(/i,()) -/i|(0))<A 


(21) 

where 


A'=  (e,j).  / = I I..  i = 


i - a I 
J a* 


(y)(/i;(v)  -fii{0))dy. 


and  let  /3(0)  and  a he  the  row  vectors 


(22) 


§{0)=il3,m) /8a(0)).  «=(<). m.) 


Then  (19)  can  he  rewritten  as 


aU-E)  = EH)). 


where  E is  the  transpose  of  E. 

Now  if  (/  — £■)  is  a nonsingular  matrix  then 


(23) 


o = l3{0){l-E) 


Hence  using  (13)  we  obtain 


(24) 


f{x)  = fi{n)(l-E)  Vd.v). 


iliiliMiwMflili 
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whfre  «(t)  is  the  column  vector 


I .»  ) / 


Mence 
1 25) 


/(()) 


= 1—  f I {x)tlx=  I — ' f a{x)dx. 

J«‘ 


ri' 

where  I or(  j )dx  is  the  column  vector  by  integrating  «(x).  Inserting  (24)  and  (25)  into  (5)  yields 

i26»  ( / ) ) = l/j(/)^(0)(/  — A)  ‘<»(  v)d.» -t  ,l/(f ) ^1 --^(0)  (/ — A')  ’ a(.r)djtj. 

Inserting  (25)  and  (26)  into  (4)  yields  the  required  cost  function 


Cl 


(27)  (:ih.t)  = 


.Wj.(/)^(0)(/-/;)  'aix)dx*  {r, Min +(■■.)  (I -k)  ' a(j:)<yxj 


4.  Cib,t)  FOR  ERLANG  mSTRIBLTIONS* 

The  p.d.f.  of  an  Erlang  distribution  with  m stages  is 


(28) 
a. id 

It  can  be  verifii.  c easily  that 
(29) 


J{i)  = Ke 


(m  — I ) !' 


A (/)=e 


t > 0 


1^0. 


[M^+  V)]‘ 


A’(  y) 


y (Ay)- 

A f! 


i ? 0 


and 


'■y  [K{t  + y)V 

r.  , Pu  + y)  ‘■ 

tyit)=— = C 


f(y) 


i! 


/ ^0. 


P'rom  |1,  p.  57|  we  have 


(30) 


>/{/)  = 


m III  " 1 — flJ 

j=i 


\t 


m = I 


*The  distribution  used  as  an  example  in  |7|  l>elon|is  to  tills  family  <»l  distributions. 
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and  hence 

X «»  • 

mU)  - y m ^ I 

H 


where  0 — e'^'  an  mth  rout  ol  unity. 

I sinj£  the  hinoniial  expan>ion  it  i>  easy  to  verily  that  /(r  * > I in  i28l  -atislie:.  il2l‘.  Hence  we  can 
Use  (25i  and  (26l  to  cotnpute  / (0)  and  A.^l  l/j-lr)  |,  respectively. 

We  now  carry  out  the  detailed  calculations  for  the  two  stage  Krlang  distrihiition  with  A = 1 iclearly 
there  is  no  loss  of  generality  since  this  inv«dvcs  only  a s»  ale  change). 

In  this  case  m = 2.  Henct-  (28).  2^1  and  i.'fOl  liecoine 


1 28' I 


/ ( / ) = f C ' . / 2-  0 


/'(/)  = e '(  i • / ).  / 2-0. 


i24'i 


r 2=  0 


idO) 


, . 1 V 

A„m=^e  ' --  --  -. 

l/in  - 1,4(2/  - 1 ’ e -'I. 
m ( / ) = I 2 ( I — e I . 


Inserting  (2^' ) and  i.HO'  i into  i6i  and  (1 1 1 we  ohiain 


i.'Hi 


»/„(/!=  14  2/ 


•jr 


niyi  I ) = 


I sing  |28'  I and  i.'f  1 1 to  comput<-  isee  i lOli  we  obtain 

0 ^ \ ^ 0 • < s h. 

0 « V -s  /<.  0 < < s h 

where 


(32) 

Hence 


c ■'  1 1 ' « I r , V - 1 

rv-r  ^ ' I 

1 [ } * ^ 


!^us=it\i  \ y)  ^ a:(  > I. 


*ln  fa<‘t  tti<‘  cia>*>  ot  (ii*>lrihution«  oti  fhr  l.aKurm*  |M»l\nMinial>  yAim  li  i‘Mntain'‘  tht*  i Ijww  ot  Krlan^  (ii>vtnl>u 

tions,  aliio  i IJi. 


HI  <><  K KKI’I  .m:K\5KNT  HOl  K ^ 
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(33 1 Ui(i)  = 


Ml  + .1  ) 


»,(ll  = r^  -'(1  » I).  /j,(v)=I.  /3  '>)=- 


>-  1 


2(  V-  1 I 

Hcncf  l)v  |21 1. 

(34)  C|  I = 0.  (’.'r  = I 2 [ I (•''ll*/))].  Cl-.'  = <t.  <•;;  (•  *'  ( 1 — c'M  1 — /)  ) ] 

and 

1,33)  /i,i(l)-l.  /J.lO)  -12. 

Inst^rtiii)!  (33i.  i34).  and  (3.3)  inln  (24)  \it•ld^ 

(•  •'I  1 + I ) (•  '•(  1 • /)) 

(.36)  / ( , ) ^ rZV7TT-T7j-  " ‘ ^ 

h rnm  (33) 

(37) 


I" 

Jit  • 


<»i  («)//«=  1 — T; . I (».(>)(/«  = /«'  ■'  ■ '• 


ln^t■rtin^:  (34).  l33).  and  i37)  into  (23i  yield' 


(3«) 


/(O)  e 


/, 


/)(  I • /.)e  -'•'• 


2 2-2e  -•'tl-e'-d-/;)) 

Insertin):  i30'i,  i3l ),  (36).  and  (38i  inlo  (5)  yieldc 

( I - e -')e  '•(  I • /)) 


(34) 


/■..[W.ulj  14 


2f-  — 


• /()  - 
-/()). 


1 

( 1 - e -') 

'•(  1 • //) 

('• 

h /,(  1 '/))(•  ■■'•'• 

•f/ 1 

1 - e -'(  1 

(■'•(  1 - /.)  1 

\ ' t* 

1 t 

.’*2*2  ~~2e  ^l~e''(  1-  /. ) ). 

e -'(  1 -e'l  I 

Insertinj:  (38)  and  (3*/)  inlu  (4)  vield'  llie  rojuired  e<>'l  lunclmn. /.  I /».  M with 
(40)  Cdi.l 


In  principle  it  is  possihlc  to  find  the  values  <>l  (/>*.  f*l  which  ininimi/e  /.(/).  i)  hy  eninputin): 
f)6'( /).  / I'd//  and  d/.'( //.  f ) V)/,  setting:  tliein  c(|ual  to  zero  and  'olviii);  the  two  e(|uations  for  //*.  r*.  Of 
course  this  is  not  a practical  wav  of  finding:  the  optimal  value'  of  A*,  l*  and  it  is  simpler  to  use  a com- 
[inter  routine. 

It  is  interestin)’  to  compare  the  minimum  cost  ohtainahle  with  a modified  HKP  with  the  minimum 
cost  ohtainahle  with  a standard  BKI*.  I.et  (Ah* . I*)  he  the  minimum  cost  for  the  modified  HRI’  and 
f.'(r»l  the  minimum  cost  for  a standard  RKP.  Ohviously  the  hlock  re[)lacemcnt  intervals  t*  lor  tlie  rr.odi- 
fieil  BKP  and  tu  for  the  standard  BKP  are  in  tieneral  different. 

\ numerical  analysis  of  formula  i40i.  where  the  item  life  distrihution  is  assumed  to  he  two  stage 
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Erlang,  shows  that  one  can  save  up  to  ,S  percent  by  using  tlie  modified  BKP.  For  0.25  ^ 0.4,  the 

modified  BRP  is  cheaper  than  a Failure  Keplai-einent  I’idicy  (a  pcdicy  of  replacing  items  only  at  failurel 
while  the  standard  BRP  is  definitely  inferior  to  the  FRP  (see  (1,  p.  %||. 

It  seems  reasonable  that  we  could  have  obtained  much  higher  savings  with  a modified  BRP  if  we 
had  chosen  an  Erlang  life  distribution  with  many  stages. 
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EXPLICIT  FORMULAS  FOR  THE  ORDER  SIZE  AND  REORDER 
POINT  IN  CERTAIN  INVENTORY  PROBLEMS 
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ABSTRACT 

This  study  (oricentrates  <m  distrihiitions  of  li^adtimt*  demand  thiit  permit  explieit 
solution  t(»  the  lot-size,  reorder  p<»int  model.  I'he  optimal  order  size  fur  thi  general  ease  is 
first  expressed  as  a function  of  the  ecomimic  order  quaiitity  and  a quantity  kno\Mi  as  the 
‘'residual  mean  life*’  in  reliability  theory.  The  concept  of  “no  a^int^**  is  then  utilized  to 
identify  a l>road  class  of  distributions  for  which  the  optimal  order  size  c an  be  determined 
explicitly,  independent  (d  the  reorder  point 

1,  INTRODUCTION 

In  section  4-2  of  their  I)ook,  Hadlev  and  Whitin  l.S]  discuss  a class  of  static  inventory  models 
usually  known  as  the  “lot-size,  reorder  point”  models.  These  models,  although  approximate  in  nature, 
are  used  fre(|uently  by  the  practitioners  because  of  their  simplicity  and  ease  in  application.  To  further 
facilitate  their  use.  the  above  authors  have  developed  an  iterative  technique  wh.ih  is  heuristic  yet  quite 
efficient  for  most  practical  problems  under  the  model.  However,  use  of  this  technique  may  in  some  cases 
require  repeated  evaluation  of  an  integral  which  may  not  be  easy.  For  this  reason  we  investigate  here 
if  in  certain  of  those  cases  the  difficulty  in  iteration  may  be  avoided  and  the  solution  obtained  algebra- 
ically by  using  an  explicit  formula. 

2.  THE  RESULT 

For  the  sake  of  brevity,  we  retain  the  assumptions  and  notations  of  Hadley-Whitin  to  the  extent 
possible  in  our  discussion.  This  enables  us  to  quote  the  following  results  directly  from  reference  [.3]: 

K = expected  total  system  cost  per  unit  time 


ttK 

~Q 


where 


= — +|^-  + r-/z  J/L  + — rj(r) 


17(f)  =j  xh{x)tl-x  — rH{r). 

Further,  the  determining  equations  for  the  optimal  (J  and  r (that  minimize  K)  are 
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f 


(1) 


2X^  2n\r){r)  V'- 

J 


(2) 


QIC 
H(r)=  — 
ttK 


Let  us  now  introduce  the  notation 


/i(r)  =iq{r)IH{r) 


so  that  equation  ( 1 ) can  be  rewritten  as 

r 2X4  2TrKB(r)H{r)  li  2 

Ic  J ■ 

Substituting  the  right  hand  side  uf  equation  (2>  for  H(r)  in  the  above  expression  we  then  get 


(3) 


where 


Wilson’s  economic  lot  size. 


Hence,  squaring  both  sides  of  equation  (3)  and  transposing  terms 

(4)  Q'--mr)Q-Qi  = Q. 

Solving  the  above  for  (^  > 0,  and  denoting  the  optimal  values  by  Q*.  r*  it  then  follows 

(5)  (^*  = ^(r*)  + {|3-{r*H-(fi, }>'==. 


Under  the  present  model  the  optimal  order  size  can  thus  be  expressed  as  an  expUcit  function  of 
/3(r*)  and  Qu--  However,  the  factor  /3(r*)  which  is  known  as  the  "mean  residual  life”  function  may  not 
be  explicit.  Therefore,  a closed  form  expression  for  Q*  can  be  obtained  only  if  /3  can  be  written  expli- 
citly in  a convenient  form.  Of  course,  if  the  distribution  of  leadtime  demand  is  such  that  /3(r)  is  inde- 
pendent of  r,  then  Q*  possesses  a remarkably  simple  expression. 

We  now  proceed  to  illustrate  determination  o\  Q*  whether  /3(r)  is  constant  or  not. 

3.  EXAMPLES 

Let  us  first  consider  the  case  of  uniform  distribution  of  leadtime  demand.  This  distribution  is  most 
often  used  to  demonstrate  the  Hadley-Whittin  method;  an  explicit  solution  for  this  case  can,  however, 
be  obtained  as  shown  below. 


i 

3 
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Example  1 
Let 


h{x)=(b-a)-\ 


« b. 


n 


-s 

S 


Then  it  is  easily  verified  that 


H(r)  = {b-r)l(b-u)< 


^(r)  = [b  - rV-l {20>  «)}• 


/3(r)  = (/)-r)/2. 


From  equation  (2)  we,  therefore,  get 


, Q*IC 


h — a 


trk 


so  that 
(6) 

where 

Hence 


b-r*  = aQ* 


a = 


(b-a)lC 
ttX 


2/3(r*)<?*=  {b  - r*)Q*  - aQ*' 

S„b.,u..m*  .Ke  ab...  ,n  e<.u.,io„  ,4)  .nd  si.pld„nb.  pe, 

= (1  — a)  ’ ~Qu- 


Finally,  from  equation  (6)  we  derive 

^*^l,^aQ*  = b-a(\-a)  ' '^Qu- 

Next  we  consider  a case  where  0(D  is  constant. 


Example  2 

Let 


r ^ ®, 


where  Ox^di  are  positive  parameters 
distribution.  By  integration  it  is  easy  to  ven  y 


h{x)  = B2  ■ expl-fliJc)' 

(that  may  depend  on  a)  such  that  h(x)  is  a 


proper  probability 
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H(r)  = {Oiie,)  exp(-rfli), 
i?(r)  = {Oildi)  • e\p(-r0,). 

^{r)  = lie,. 

Therefore,  from  equations  (5)  and  (2) 

r*=  (l/fl.)  • {ln(7rXfl2)  - ln(0*/Ce,)}. 

Note  that  the  above  formula  for  Q*  is  independent  of  r*,  although  that  of  r*  involves  Q*.  What  is 
more  noteworthy  is  that  Q*  does  not  depend  on  the  penalty  cost  parameter  n.  These  properties,  as 
proved  in  Das  [2],  are  special  to  distributions  with  constant  /3.  The  rest  of  the  paper  is,  therefore, 
devoted  to  a detailed  study  of  this  class  of  distributions. 

4.  DISTRIBUTIONS  WITH  CONSTANT  fi 

As  mentioned  and  illustrated  above,  distributions  with  constant  fi  enjoy  some  special  properties 
that  give  rise  to  simplification  in  inventory  decision-making.  These  distributions  are  also  of  independent 
interest  in  reliability  theory  since  constant  fi  is  equivalent  to  the  property  of  “no  aging"  — a concept 
that  is  valuable  in  reliability  studies.  Regarding  their  characterization,  it  is  widely  known  that  among  all 
continuous  distributions  defined  on  the  positive  half  of  the  real  line  only  the  negative  exponential  dis- 
tribution exhibits  this  special  property.  Example  2,  however,  shows  that  the  truncated  exponential 
distribution  which  includes  the  regular  negative  exponential  as  a special  case  also  possesses  the  same 
property.  F’or  inventory  applications  of  this  result  we  must,  of  course,  verify  that  the  truncated  exponen- 
tial is  a realistic  distribution  of  leadtime  demand.  This  is  particularly  important  here  because  leadtime 
demand  being  in  general  a random  sum  of  random  variables  has  a compound  distribution  to  which  the 
truncated  exponential  might  not  be  a good  fit.  However,  this  doubt  is  removed,  at  least  in  part,  by  the 
following  example  where  we  allow  both  the  demand  per  unit  time  and  leadtime  to  follow  a fairly  realistic 
distribution  each  but  the  leadtime  demand  distribution  emerges  as  the  truncated  exponential. 

Example  3 

l.et  us  assume  that  the  demand  per  unit  time  is  distributed  normally  with  mean  ft  and  variance 
CT-.  and  that  leadtime  is  random  having  a negative  exponential  distribution  with  mean  y The  con- 
ditional distribution  of  leadtime  demand  given  that  leadtime  is  m.  is  then  normal  with  mean  mp,  and 
variance 

h(x\m)  = ('JniTTO-'-)  ' ' exp  { — (x  — m/x) -/2m<r-}. 

The  marginal  distribution  of  x is,  therefore,  given  by 


(7) 


/i(r)  = 6l  /i(  vjrn  ) exp  ( — ym  )f/m. 
Jo 
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le  .,f  e,uaL  ,7,.  Af.e,  .„me  ......ificion  i,  is  seen  ,.s,  ,hls  ,„..*r.l  reduees 


(8) 


(2770-“)'' 


where 

/(jf)  = ["  m ''*  exp{-(jr-  + m'^p-) I2m(r-}dm, 
Jo 

p-i  = + 2y<T-. 

•r,,  evaluate  IM.  I«  u,  now  mate  ihe  t«n..»inf  Uansturmaliun 

/•:=  (p-l2a--)m. 


I{x]  ran  then  he  written  as 


ly) 


/(^)  = 2"-(<r/p)./(«) 


vhere 


From  the  table  of  intefirals  (see  [4].  p.  305,  i 


/(«)=  [ t'xp  [-{>'-4  («/y)'}]f/y> 

Jo 

a = (pl2<T~)x. 

integral  no.  427).  we  next  hnd 


./(<,)=  (1/2)77''-^  exp(-2«). 


Hen<-e  substituting  the  above  in  equation  (9)  we  get 

/(^)=  (2it)'  -{(Tip)  exp  {-pxl(T-) 


Therefore,  utilizing  equation  (8)  we  hnally  arrive  at 

h{x)  = (8/p)  • <*xp  {-{p-  ^x)x|(T■} 


which  is  nothing  but  the  truncated  exponential  distribution 
p)/a^.  In  particular,  if  we  assume  0 ^ x ^ x.  then  5-  p«. 
exponential  distribution. 


of  example  2 with  O’ 
so  that  b{x)  becomes 


= 8/p  and  fli-  ip~ 
the  regular  negative 
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Similarly,  it  can  be  shown  that  if  the  demand  per  unit  time  itself  is  negative  exponential  and  the 
leadtime  is  geometric,  then  the  leadtime  demand  is  negative  exponential.  In  this  context  we  may  also 
mention  Carlson’s  [1]  result:  if  the  leadtime  distribution  is  geometric,  then  for  any  arbitrary  distri- 
bution of  demand  per  unit  time  with  finite  cumulants  the  leadtime  demand  is  asymptotically  exponential 
as  the  mean  leadtime  increases. 

As  regards  discrete  distributions  of  leadtime  demand,  we  may  point  out  that  the  geometric  distri- 
bution being  the  discrete  analogue  of  the  exponential  possesses  the  ‘ no  aging”  property.  Therefore, 
pairs  of  distributions  such  that  their  compound  is  geometric  will  generate  leadtime  demand  distribu- 
tions of  constant  /3  for  the  discrete  case.  An  excellent  example  of  this  occurs  when  demand  per  unit 
time  is  negative  Binomial  and  the  leadtime  is  geometric  (see  Magistad  [5]). 

5.  CONCLUDING  REMARKS 

The  class  of  leadtime  demand  distributions  permitting  explicit  formulas  for  the  decision  variables 
under  the  lot-size,  reorder  point  model  is,  therefore,  not  so  narrow  as  might  appear  to  he.  Further,  if 
approximate  solutions  are  acceptable,  then  this  class  can  he  augmented  by  admitting  distributions 
that  can  he  approximated  by  those  with  constant  /3.  For  instance.  Presulli  and  Trepp  [6]  show  that  the 
standard  normal  distribution  can  he  approximated  by  a function  of  the  form  O-..  exp{— di  | } . where 
di  = 2'  ''‘.  Hence,  if  the  leadtime  demand  distribution  is  normal  with  arbitrary  mean  and  standard 
deviation  cr.  then 


(Mr)  ^ (tIOi  = ((T-72)  ' - 

so  that 

Q*  - (<t'72)'  -’  + {(cr-72)  ( (>;,}'  7 

Besides  provioiug  such  explicit  formulas  the  function  also  facilitates  various  sensitivity  studies  of 
the  model  discussed  here.  An  application  of  this  nature  can  he  found  in  Das  [2]. 
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ABSTRACT 

This  papt*r  considers  the  problem  of  computing  reorder  points  and  order  quantities  for 
continuous  review  inventory  systems  subject  to  either  a service  level  constraint  or  a con- 
straint on  the  average  fraction  of  lime  out  of  stiK^lc.  It  is  demonstrated  that  three  apparently 
distinct  models  are  equivalent  under  these  circumstances.  Using  this  equivalence,  stream- 
lined algorithms  for  computed  lot  sizes  and  reorder  points  are  developed. 


BACKGROUND 

Although  the  literature  aixtunds  with  numerous  descriptions  of  inventory  models,  only  a very  few 
of  these  have  ever  been  applied  to  a real  inventory  control  problem.  Most  are  too  time  consuming  and 
complex  to  be  of  use  in  large  nmltiproduct  systems,  or  require  too  many  restrictive  assumptions  to  hold. 

Since  it  is  very  rare  that  demands  are  known  with  certainty,  we  will  restrict  our  attention  to  the 
situation  in  which  demands  are  random  variables  with  a known  probability  disfibution.  When  demands 
are  random,  there  are  essentially  two  distinct  classes  of  inventory  models:  periodic  review  and  con- 
tinuous review.  In  the  periodic  review  case  it  is  assumed  that  the  state  of  the  system  is  reviewed  at 
fixed  points  in  time  (i.e.  periodically)  while  a continuous  review  inventory  model  would  be  applicable 
if  the  state  of  the  system  is  known  at  all  times.* 

Although  nost  industrial  inventory  control  systems  fall  into  the  periodic  review  category,  the 
literature  suggests  that  most  scientific  inventory  systems  in  use  utilize  a continuous  review  methou- 
ology.  There  are  a number  of  reasons  for  this.  Equations  for  the  continuous  review  case  are  similar 
to  the  familiar  lot  size  equation  and  hence  are  more  easily  understood.  In  addition,  when  there  is  a 
fixed  charge  (or  set-up  cost)  for  placing  an  order,  optimal  policies  are  quite  difficult  to  compute  under 
the  periodic  review  assumption,  and  truly  effective  approximations  have  yet  to  be  developed.  A third 
re„son  is,  perhaps,  that  when  the  review  period  is  relatively  small  and  units  are  demanded  on  a one  at 
a time  basis,  a continuous  review  approach  provides  an  extremely  good  approximation. 

OPTIMAL  POLICY 

When  units  are  demanded  one  at  a time  and  the  underlying  demand  distribution  is  unchanging  with 
time,  it  is  well  known  (see  for  example  Hadley  and  Whitin  [4] ) that  the  optimal  policy  is  of  the  following 

* Hadley  and  Whitin  [4]  use  the  term  transactions  re|H>rting  as  it  indicates  that  transuf'tiims  are  reported  as  they  take  place. 
However  since  cortinuous  review  appears  to  he  the  more  accepted  term,  we  will  use  it. 
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form  — whenever  the  on  hand  inventory  falls  to  a level  r.  an  order  is  initiated  for  an  amount  Q to  arrive 
T units  of  time  into  the  future.  This  poliey  is  optimal  in  that  it  minimizes  the  expected  average  cost  over 
infinitely  many  ordering  cycles. 

Computing  values  of  (0,  r)  optimally  appears  to  be  an  extremely  difficult  problem,  and  those  cases 
for  which  solutions  do  exist  are  quite  restrictive  and  still  require  prohibitive  computation.  We  consider 
two  simple  approximations  that  have  been  suggested  in  the  literature,  but  before  presenting  them  we 
require  the  following  definitions.  Our  notation  follows  that  of  Hadley  and  Whitin  [4]. 

DEFINITIONS  AND  ASSUMPTIONS 

A'  ( T ) = demand  during  lead-time  t. 

H (t  ) = P {X  (t)  >/}  = probability  that  lead-time  demand  exceeds  t. 

X=  average  or  expected  number  of  units  demanded  each  year. 

C = dollar  value  of  each  individual  unit. 

/=  cost  of  carrying  one  dollar  of  inventory  for  1 year. 

A = cost  of  placing  an  order. 

n(t)=E{  max  (X(t)  — t,  0) } = expected  number  of  units  which  go  short  during  a lead  time  when 
the  reorder  point  is  t. 

In  the  development  of  the  mathematical  model  the  following  assumptions  are  made: 

Al.  Costs  are  charged  against; 

(a)  ordering  at  CQ  + A if  0 > 0,  0 if  (>  = 0, 

(b)  holding  at  IC  per  unit  held  per  year, 

(c)  shortage  at  ti  per  unit  short. 

A2.  There  is  never  more  than  a smgle  order  outstanding.* 

A3.  The  reorder  point  is  r > 0. 

A4.  Excess  demand  is  backlogged. 

Based  on  these  assumptions,  Hadley  and  Whitin  [4]  develop  an  approximation  which  requires 
the  simultaneous  solution  of  the  two  equations; 


(i: 


Q=yj  (A-\-  TTn(r)) 


(2) 


W(r)  = 


QIC 

nk 


By  modifying  their  derivation  slightly,  Wagner  [9]  has  obtained  the  two  equations: 


(3) 


•«(r) 


‘This  assumption  may  he  relaxed  if  the  on  hand  plus  on-order  minus  haekorder  inventory  is  compared  to  the  trigger  point  r. 
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(4) 


H{r)  = 


2QIC 

ICfi  + 27tX 


The  symbol  fi  is  used  to  represent  the  mean  lead  time  demand  and  is  equivalent  to  kr. 

Both  of  these  systems  may  be  solved  fairly  efficiently  by  the  following  algorithm: 

Algorithm  1 

(a)  Choose  the  initial  value  of  (1=  V ‘IkAjlC. 

(b)  Find  r from  (2)  or  (4). 

(c)  Find  Q from  (1 ) or  (3)  using  the  value  of  r computed  in  (b).  Slop  when  successive  values  of  either 
Q or  r arc  equal  or  are  sufficiently  close  (that  is,  within  a prespecified  tolerance). 

In  using  Hadley  and  Whitin’s  model  an  implicit  assumption  is  that  the  value  of  the  backorder  cost, 
7T,  is  sufficiently  large  so  that  the  term  QlCjirk  is  always  less  than  one,  otherwise  (2)  would  not  make 
sense.  Since  it  is  possible  that  2QICIilCix  + 2nk)  < 1 while  QlChrk  > 1 it  can  happen  that  for  some 
small  values  of  tt  equations  (3)  and  (4)  may  yield  a solution  while  (1)  and  (2)  will  not.  This  is  certainly  one 
advantage  of  Wagner’s  approach.  However,  a recent  study  by  Gross  and  Ince  |3]  indicate  that  in  general 
Hadley  and  Whitin’s  model  is  closer  to  the  optimal  than  Wagner’s  a greater  portion  of  the  time.  The 
authors  speculate  that  perliaps  the  Hadley-Whitin  model  has  compensating  errors  which  allow  it  to 
perform  better  in  many  cases.* 

An  advantage  of  these  simple  models  is  that  they  can  be  modified  to  allow  for  a variety  of  generali- 
zations including  incremental  or  all  units  quantity  discounts,  orders  which  must  be  a multiple  of  a fixed 
batch  size,  problems  with  space  or  budgetary  constraints,  and  cases  where  the  lead  time,r,  is  not  known 
with  certainty  hut  is  a random  variable.  Hadley  and  Whitin  discuss  the  modifications  necessary  in  the 
computations  to  deal  with  situations  of  this  type. 

SERVICE  LEVELS 

A serious  problem  with  actually  applying  the  two  models  defined  above  is  that  it  is  often  difficult 
if  not  impossible  to  assign  dollar  values  to  the  cost  of  shortage.  As  an  alternative,  one  may  specify  either 
the  service  level  (probability  of  a stockout  occurring  during  lead  time)  or  the  average  time  out  of  stock 
(probability  that  any  unit  demanded  can  be  satisfied  with  available  stock).  The  latter  is  also  referred  to 
as  the  fill  rate.  Although  it  is  evident  that  there  exists  a great  deal  of  confusion  regarding  the  distinction 
between  these  two  criteria,  their  difference  is  discussed  at  length  in  a number  of  places.  (Brown  [1]  is 
one  example.)  Gross,  Harris  and  Bobers  [2]  present  an  algorithm  for  computing  (Q,  r)  values  using 
Wagner’s  model  (equations  (3)  and  (4))  when  the  service  level  is  specified.  The  same  method  can  be  used 
for  Hadley  and  Whilin’s  model.  If  we  can  assume  that  a is  the  prespecified  service  level  then  the 
method  is; 


Algorithm  II 


(a)  Let  the  initial  value  of  (1=  V2X.4//C. 

(b)  Find  r by  solving //(r)  = a. 

(c)  Compute  rr  from  (2)  (or  (4)). 


*I  am  indebted  to  the  referee  for  brintdng  this  reference  to  my  attention. 
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(d)  Find  n(r)  *. 

(e)  Compute  the  new  value  of  Q from  (1)  (or  (3)). 

Return  to  (c)  or  terminate  computations  when  successive  values  of  ^ or  r are  equal  or  are 
sufficiently  close. 

The  same  approach  can  be  extended  to  develop  an  algorithm  for  computing  (Q,  r)  values  when  the 
average  fraction  of  time  scent  out  of  stock  is  specified.  Hadley  and  Whitin  describe  the  following 
procedure  for  computing  the  optimal  (Q,  r)  values  subject  to  the  constraint  n(r)lQ- 

Algorithm  III 

(a)  Choose  an  initial  value  of 

(b)  Using  TTo  find  the  optimal  values  of  ((),  r)  solving  (1)  and  (2)  (or  (3)  and  (4)).  This  involves 
iterating  successive  values  of  {Q,  r)  as  described  in  Algorithm  I. 

(c)  For  the  given  solutions  obtained  in  (b)  compute  n{r)IQ.  If  n(r)IQ  > p rht)ose  it  > ttu  and  return 
to  (b).  If  n(r)IQ  < /3  choose  tt  < tto  and  return  to  (b).  Stop  only  when  n(r)IQ  is  sufficiently  close 
to  /3. 

Anyone  who  has  had  any  experience  with  this  algorithm  can  attest  to  the  fact  that  it  is  extremely 
time  consuming.  Choosing  the  proper  values  of  tt  at  each  stage  is  largely  a hit  and  miss  affair,  and  to 
obtain  an  accurate  solution  may  require  as  many  as  400  computations. 

We  will  de;nonstrate  that  both  of  these  algorithms  can  be  streamlined  considerably  with  no  loss  in 
accuracy.  The  value  of  tt  may  be  completely  eliminated  from  equations  (1)  and  (2)  as  follows:  From 
equation  (2)  we  have  that 

TT  = QICIkH(r). 

Substituting  this  into  equation  (1)  we  obtain: 


which  can  be  seen  to  be  a quadratic  equation  in^.  The  positive  root  obtained  from  the  quadratic  formula 
is: 


(5) 


j(  n(r)\-  2X4 


It  is  surprising  to  note  that  had  we  solved  forrr  in  (4)  and  substituted  into  (3)  we  would  still  obtain 
equation  (5)  as  the  solution. t When  the  lead  time  demand  distribution  is  exponential  oris  approximated 


* n(r)  = j x/i(x)dx  — rH(r)  where  A(i)  = 

When  lead  lime  demand  is  normally  disiribuled,  n(r)  may  he  obtained  as  a funetion  of  the  standardized  loss  integral.  See  Hadley 
and  Whitin  [4],  Wagner  [9]  or  Brown  [1]. 

tThal  these  two  apparently  different  sets  of  equations  yield  identieu'  '(.K  r)  values  when  a service  constraint  is  imposed  is 
quite  surprising.  What  will  be  different  is  the  imputed  cost  of  shortage.  : the  value  of  rr  obtained  from  Algorithms  II  or  III. 
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by  an  exponential  tail,  the  variable  r drops  out  of  equation  (5)  so  that  the  order  quantity  may  be  deter- 
mined independently  of  the  reorder  point.  This  special  case  is  discussed  by  Parker  [6] , Presutti  and 
Trepp  [7]  and  Schroeder  [8].  Brown  [1]  has  also  obtained  equation  (5)  by  a different  derivation.  Hence 
we  see  that  when  dealing  with  service  constraints,  the  models  of  Hadley  and  Whitin  (equations  (1)  and 
(2)),  Wagner  (equations  (3)  and  (4))  and  Brown  (equation  (5))  are  all  identically  equivalent. 

The  use  of  equation  (5)  completely  eliminates  the  need  of  an  algorithm  to  determine  the  optimal 
(Q,  r)  values  when  a service  level  constraint  is  imposed.  If  we  let  a = probability  of  stockout  during 
leadtime,  then  the  reorder  point  r is  computed  to  satisfy  the  equation 

H{r)  = a. 

Since  specification  of  r determines  n(r) , the  optimal  lot  size.C).  may  be  computed  directly  from  equa- 
tion (5)  (with  a substituted  for  H(r)).  The  optimal  {Q,  r)  values  obtained  in  this  manner  will  be  iden- 
tical to  those  computed  from  Algorithm  II  independently  of  which  model  is  used.  By  eliminating  the 
need  for  an  algorithmic  solution,  the  use  of  equation  (5)  can  reduce  computation  time  by  as  much  as  a 
factor  of  10  or  20. 

Equation  (5)  can  also  be  used  to  significantly  reduce  computation  time  for  the  more  common  case 
when  /3  is  specified  as  the  average  fraction  of  time  spent  out  of  stock.  In  that  case  the  following  al- 
gorithm would  be  utilized; 

Algorithm  IV 

(a)  Pick  an  initial  value  of  (J~  \ 2X.ijlC. 

(b)  Compute  r from  the  equation /i(r)  =/3(). 

(c)  Compute  Q from  (5).  Return  to  (1))  or  terminate  computations  when  successive  values  of  Q 
or  r are  equal  or  are  sufficiently  clo^i;. 


.Algorithm  IV  will  yield  the  identical  (C^,  r)  values  as  those  obtained  from  .Algorithm  111.  but  with 
a very  small  fraction  of  the  computations.  In  fact,  depending  upon  the  accuracy  desired.  Algorithm  I\ 
may  require  as  little  as  1 percent  of  the  computation  time.  This  is  certainly  a significant  difference 
especially  when  considering  that  such  computations  iniglit  be  ocrformed  repeatedly  for  thousands  of 
items  on  a continuing  basis.  Note  also  that  once  the  optimal  values  of  ((,.*.  r*  are  determined,  the 
imputed  cost  of  a backorder  may  be  computed  from  either  equations  (2)  or  (4). 

In  addition  t;>  the  fact  that  equation  (b)  significantly  streamlines  previous  algorithms,  there  are  a 
number  of  interesting  conclusions  which  can  be  drawn  from  the  equivalence  which  we  have  demon- 
strated: 

(1)  Although  the  formulas  presented  by  Brown  [IJ,  Hadley  and  Whitin  [4]  and  Wagner  [9] 
appear  to  b-;  diffe'**".’  jil  three  models  will  yield  identical  results  when  a constraint  is  placed  on  either 
the  prob„  ’ , ,:ockirg  out  during  lead  time  or  the  average  fraction  of  time  out  of  stock. 

(2)  Equation  i.S)  remains  valid  for  any  lead  inoe  demand  distribution.  H(r).  It  is  not  necessary  to 
assume  an  exponential  approximation. 

(3)  Since  equation  (5)  obtained  b>  Brown  [1]  is  equivalent  to  two  approximate  models,  it  itself 
must  be  an  approximation. 


36 


S.  NAHMIAS 


i 

j 


(4)  The  use  of  equation  (5)  significantly  reduces  computation  time  (tver  Algorithms  II  and  III 
when  either®  (service  level)  or /3  (fraction  of  time  out  of  stock)  are  specified. 
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ABSTRACT 

In  thi>>  paper  ne  < «>riM<ler  a mullipehoil  determini^tir  < apuntv  expatiMon  and  shipment 
piannint!  prolilein  for  a oin^le  produc  t 1 he  pr(»du<'!  ran  he  manufartuied  in  oeveral  ttr>>d)j('in^ 
reiuon>  and  \s  re«|uired  in  a numher  of  market'^.  The  <ieinands  tor  t at  h ot  the  market^  aie  non 
(iecTea^ini^  over  time  and  musi  lie  met  exaeilv  duniift  each  time  period  li.e..  no  harklofijanft  or 
invenloryinft  for  tuture  penod>  i'>  (lermitted).  Karh  reiuon  i«>  a^>umed  to  have  an  initial  pro- 
duction capacity,  which  may  lie  increased  at  a loven  cost  in  anv  period.  The  demand  in  a 
market  < an  he  '>aiished  |iy  production  and  shipment  from  any  of  the  repons.  The  pnddem  i*^ 
to  hnd  a *>chedule  o|  t apacity  expansions  for  the  rrpoiis  and  a schedule  of  shipment'*  tror^ 
the  repofio  Id  the  markets  so  as  to  mimmir.e  ilie  discounted  < apaeiiv  e\pan>*ion  and  shipment 
costs.  The  prohlern  is  formulated  <is  a linear  pr(»t!ramtiiiii^  model,  and  so|\rd  hv  an  efhcient 
alpirilhin  usin^t  the  operator  theory  o|  parametric  prop-ammin^  lor  the  transporation  problem, 
extensions  to  the  infinite  horizon  case  are  also  provided. 

I.  INTRODICTION 

Th*-  <letermirii>lic  mullipt'riod.  multiprorlui'ing  rfgiiin  capacit)  expansion  prcilil«*ni  with  cuncavc 
capacity  expansion  costs  was  lirsi  (iropo>ed  by  Manne  [+].  KxacI  optimal  solutions  to  the  prolilem  can 
he  obtained  by  using  dynainic  programming  formulations  [1.2.  4].  However,  owing  to  the  ■‘cui'c  of 
dimensionalitv".  a proldem  with  more  than  three  producing  regions  is  computationally  prohibitiM-. 

In  this  paper  we  make  the  assumption  that  the  capacity  exftansion  costs  arc  linear  rather  than 
concave.  Linear  capacity  expansion  costs  may  he  realistic  in  the  ease  of  firms  wliirh  rent  or  subcontract 
their  production  capacities  from  otlier  firms  or  when  the  hxed  components  in  the  capacity  expatision 
costs  are  relativelv  small.  -Such  a formulation  is  also  realistic  in  multiperiod  personnel  assignment  prob- 
lems with  different  types  of  jobs  as  markets  and  different  training  programs  dehning  the  producing 
regions.  In  such  contexts,  the  cost  of  recruiting  and  training  may  he  best  approximated  as  linear.  More- 
over. the  optimum  solution  to  the  problem  with  linear  costs  can  he  used  to  provide  a lower  hound  to  the 
ohjertive  function  of  the  problem  with  r-om  ave  expansion  costs.  This  information  is  useful  in  a branch 
and  hound  approach  to  sidving  the  pnd)leni  under  concave  expansion  <‘osts.  especially  if  the  linear  prol)- 
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lem  can  be  solved  efficiently.  Further,  studying  the  structure  of  the  problem  with  linear  costs  may 
provide  a basis  for  the  development  of  more  efficient  heuristics  as  aids  in  solving  the  problem  with 
concave  expansion  costs. 

In  the  next  section,  the  linear  capacity  expansion  and  shipment  problem  is  formulated  and  in 
section  3 we  develop  a solution  procedure  to  solve  it.  In  section  4 some  characterizations  of  the  optima] 
solution  as  provided  by  the  algorithm  developed  in  section  3 are  derived.  In  the  same  section  we  extend 
the  formulation  to  the  case  of  infinite  planning  horizon  and  show  how  an  optimal  solution  to  that  case 
can  be  obtained. 

2.  PROBLEM  FORMI'LATION 

We  consider  below  the  multiperiod  capacity  expansion  and  shipment  problem  (Pi)  for  a single 
product  by  defining  the  index  sets: 


/ = {1,  2 m}  set  of  producing  .••■gioiis, 

,/={l,2 n}  set  of  markets, 

/v  = ( 1 , 2 7'}  set  of  lime  periods  where  T is  the  end  of  the  planning  horizon  and, 

K'  = {2.  3 T). 


P'or  ifl.jeJ  and  t(K,  we  define 


r"  = initial  demand  in  market  j,  in  time  period  0. 

t 

r'j  — known  increment  in  market  j's  demand  in  lime  period  f.  r'^0.  Conseijuently,  ^ r'^  repre- 

r»  II 


sents  the  demand  in  market  j at  time  t. 

</''=  initial  production  capacity  in  region  i.  Capacities  are  measured  in  the  same  units  as  demands. 
= cumulative  amount  of  capacity  added  in  region  i from  period  1 to  I.  The  total  production 
capacity  in  region  i at  time  i is  (/"  + </J. 
k,  = unit  cost  of  capacity  expansion  in  region  i (k,  >0). 
x\^  = amount  shipped  from  region  i to  market  j during  period  t. 

Cij=  unit  cost  of  shipping  from  region  i to  market  j.  This  consists  of  (a)  the  cost  of  transporting 
one  unit  from  region  i to  market  j,  lb)  the  variable  cost  of  producing  one  unit  in  region  i, 
(c)  maintenance  cost  for  one  imit  of  capacity  in  region  i.  (r,j  ^ 0) 
s'l  - excess  (or  idle)  capacity  in  region  i a!  time  I (3^  0). 

h,  = unit  cost  of  maintaining  idle  caoacity  in  region  i.  Obviously  0 « A,  « Cij  for  id.jfj. 

g,  — terminal  lor  resale)  value  ol  a unit  capacity  at  the  end  of  planning  horizon  in  region  i (g,  & 0). 


a=  discount  factor  per  period  ^ — where./  is  the  appropriate  cost  of  capital  per  period^ 

0 < a < I.  Thus  a'  ' is  the  present  value  li.e.,  value  as  of  the  beginning  of  period  1 ) of  one 
dollar  at  the  beginning  of  time  period  t. 

The  problem  /*1  can  be  formulated  as  below: 

rtAif/jf/  It  h It  I it  I It  K'  It  I it  I 
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(2) 

2 

jij 

for  iel,  teK. 

(3) 

s >u-  i n 

ill  T=0 

for  jej,  teK, 

(4) 

q'f  — q'i  ' ^ 0 for 

iel,  leK' , and 

(5) 

x/j  Si  0,  s\  >0,  q'l  '^  0 

for  iel,  jeJ.  t 

where  j:,  j,  a' 

, q'j  are  the  decision  variables. 

Ohjfctivf  function  (1)  determines  the  minimum  total  time  discounted  transportation,  idle  capacity 
maintenance  and  capacity  expansion  costs.  The  costs  are  assumed  to  be  incurred  at  the  beginning  of 
each  period.  Constraint  (2)  states  that  the  amoun;  shipped  out  of  region  i at  time  I should  not  be  greater 
than  the  capacity  available  in  region  i at  time  /.  It  is  assumed  that  the  amount  of  capacity  addition  in 
region  i at  time  / , 7' — ‘ (at  / = 1 , it  is  ),  is  available  for  production  to  meet  the  demands  in  the  same 

period  t.  (Constrain!  (3)  states  that  the  amount  shipped  to  market  j at  time  t should  be  equal  to  the  de- 
mand. Constraint  (3)  implicitly  assumes  that  no  backlogging  of  the  product  or  inventory  for  the  future  is 
permitted.  This  is  quite  a realistic  assumption  since  the  unit  time  period  involved  in  these  problems  is 
usually  a year.  Since  /i,  ^ Cy  for  iel,  it  is  obvious  that  stating  constraint  (3)  as  equality  (rather  than  as  ^ I 
involves  no  loss  of  generality.  Constraint  (4)  follows  .from  the  fact  that  q\  expresses  the  cumulative 
amount  of  capacity  expansion  until  period  t. 

As  pointed  out  in  [3|.  there  is  no  established  precedent  regarding  the  method  to  be  employed  in 
computing  the  terminal  value  of  capacity.  The  life  of  a production  capacity  is  usually  much  longer  than 
a normal  planning  horizon.  Mamie  [4]  in  many  of  his  studies  a.ssumed  an  infinite  life  for  capacity.  Under 
tiiis  assumption  of  no  deterioration  in  the  manufacturing  production  capability  over  time,  we  posit 
that  the  capacity  can  be  sold  ofl' approximately  for  its  cost  value  (i.e.,  A ) at  the  end  of  the  tv’ie  horizon. 
Therefore  it  is  not  unrealistic  to  assume  that  the  present  value  of  the  terminal  value  of  the  capacities  is 
^a]kiq].  (Kor  the  infinite  horizon  case  that  will  be  considered  later,  this  assumption  is  not  needed.) 

ill 

Objective  function  ( 1 ) can  now  be  modified  to 

(6)  Min  S 2 + S 2 2 ''’*>•  ^22“'  “2 

Uh  f€l  jt.l  (fh  ifl  Ul  tth'  i*l  iti 


Regn.uping  the  cost  coefficient  of  each  q[  in  (6)  we  simplify  (6)  to  (7l. 


(7) 


222“'  ^22  ‘^22 


ttS  itl  jil 


Uh  Hi 


where  / ' = ( 1 —a)k,. 

Under  this  formulation,  the  company  is.  in  effect,  renting  at  the  rale  ./  capacities  worth  kiq\,.kiq], 
. . ..kiqj  in  periods  1,2 7"  so  that  the  present  value  of  the  rent  expenses  would  be 
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(1  +./)  "^(1  +,/)- 


[j(A,vy)] 
(I  +./)'■ 


since  .//(!  + ./  )=(!—«)  the  alxive  expression  is  the  same  as  the  last  term  in  (7).  Consequently.  (7) 
minimises  the  intuitively  appealing;  objective  defined  as  the  sum  of  total  time  discounted  transportation 
costs,  idle  capacity  maintenance  costs,  and  the  rental  costs  on  the  production  capacities. 

The  linear  cost  capacity  expansion  and  shipment  problem  can  now  he  formulated  as  problem  P2, 
which  is  minimizing  (7)  over  constraint  set  (2H.S). 

P2  can  he  solved  using  the  simplex  method  for  linear  programs.  However,  for  any  reasonably  large 
size  problem,  the  number  of  constraints  and  variables  will  he  quite  large.  For  example,  a 10-period, 
10-region,  200-market  problem  will  have  2,190  constraints  (excluding  the  non-negativity  constraints) 
and  20J200  variables  making  it  computationally  expensive. 


3.  SOLUTION  PROCEDURE 
3.1.  Development 

To  develop  an  efficient  solution  procedure  for  P2.  we  consider  the  problem  P?>  of  minimizing  |7) 
over  constraint  set  (2),  (3).  and  (.Si  li.«‘.,  after  dropping  tlie  coupling  constraints  l4l).  Problem  P3  consists 
of  a series  of  subproblems  PW  for  te  k.  Our  solution  procedure  is  such  that  the  optimal  solutions  for 
subproblems  so  obtained  also  satisfy  the  coupling  constraints  (4)  so  that  they  are  also  optimal  to  P2. 
EachP3'  is  oi  the  form: 


(8) 

(9) 

(10) 
(11) 


Min  ^ X a'  ''  i>« ^ ’ S 

it  I ttJ  it!  i«l 

2 jrJ+ .v',- forie/. 


for  ye,/,  and 


It  I r=0 


x/j  0,  .v|  3:  0,  (f\  3 0 for  iel,  j(,l. 


To  bring  each  Pi'  to  “standard  form",  we  convert  each  to  a capacitated  transportation  problem 
[5]  with  m + 1 regions  and  n -f  2 markets. 

We  define  a dummy  (n  + 1 ) market  with 


maxi 


HJ 


q?  for  ifk. 

It  I 


to  absorb  the  excess  capai’ities.  * It  is  shown  below  that  defining  ^ r'„,,  = ^ </}'  for  any  tek  is  suf- 

r=0  iti 

firient  to  ahsorh  the  excess  capacities  in  an  optimal  solution  to  /^3^ 


* In  other  word;-,  ^ q'*  ^ and  = 0 f**r  I ^ r ^ ^ . 


^ r.  - 


F.Xf’ANSION  AND  SHIPMENT  PI.ANMNC 


41 


l.EMMA  1:  In  an  optimal  solution  to /AT',  tfK.x'j  « i/'J  lor  ic/. 

PROOF:  Assume  the  eontrary,  i.e.,  3a/  such  that  s[  > q'l  0.  But  ^ + .«/  — qj.—  </"  and  hence 

jti 

we  have  q[  > 0.  Consequently,  the  ohjective  function  to  /AT'  can  he  reduced  hy  decreasing  q[  and  s[ . 
contradicting  the  optimality  assumption. 

COROLLARY  1:  In  an  optimal  s<ilution  to/AT'.^ 

iti  it! 

The  excess  "demand"  of  the  (;i  f 1 ) markets  can  he  .satisfied  hy  defining  a dummy  (m  + 1 ) region 


with  = max 


. ' mi.  I,  ,=  T/(a  large  positive  number)  for  jej . /im.i  = r,„.\,  =0 


"■2 1)' -Si; 

^ >;  ill  ‘ 

and  / mi.i  = 0,  without  increasing  the  value  of  the  ohjective  function,  (^msequently,  there  is  a one-to-one 
correspondence  between  an  optimal  solution  to  /AT'  and  an  optimal  solution  to /AT'  with  the  addition  of 
the  {in  + 1 ) region  and  (n  + 1 ) market. 

Hence,  we  can  incorporate  the  following  constraint  to  f’.T'. 


(9al 


^ -'mi- 1.7*^  •'i|||-l  Vlll-1  '/iM.I* 


III 


Eq.  (10)  is  modified  to; 


(10a) 


'2  *.'7  + -^^Mi-  i.j  = S '■/ 


(lOh) 


2 *'||..|  = X '■"-r 


Define /'  = / (J  jm  + 1 }.,/'=,/  U {n  + 1 } and  J"  — J'  U (n  + 2}. 

Following  the  method  of  |8|,  we  add  N (a  very  large  positive  integer)  to  both  sides  of  (9)  and  (9a)  t(» 
obtain. 


(91.) 


2 + (A— <7J)  = </J*  + -V  for/e/' 


III 


Summing  (9h)  over  lei'  an;!  subtracting  from  it  (lOh)  and  the  sum  of  ( 10a)  over  je,l  we  have: 

2 ( A = (m  I ).V-(  X 9"  “ S S 

itl'  itI'  T-0 


It  can  he  shown  in  a similar  manner  as  in  |8|  that  each/AT'  is  equivalent  to/'A',  which  is 


(12) 


Min  Z' = a'  '/'  = «'  I ^ ^ I ', 

^ id'  j*.r  «/' 


N 


'x'  = 

•*  17  o I 


III’ 


(13) 


for  iel\ 


*1  ■-  A"*" 
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(or  jej". 


(15) 

(16) 
where 


11*2  ^ for  j«/',  and 


x'tj^O  (or  id ',jd" 


I (oriel'. 


■*'....2=''“'/!  (oriel'. 


«"  = (/'/ +/V.  r,,„.,=hj.  — — (oriel'.  (or jd". 


(m+  1)A^+S  </'/-  2 S and/'  = ^ £ 


jf.r  r=0 


It/'  jt.r 


it  I' 


Problf'm  l*l\  is  likt^wise  converted  to  problem  P4.  wbic'b  consists  of  the  series  of  subproblems 
P4':  teK. 

It  should  he  noted  that  the  coupling  constraint  (4).  i.e. 


<l'i  ~ Q'i  ' ^ f*’*" 


is  equivalent  to 


(17) 


- xl  + rj, . 2 ^ 0 for  iel  .teK'. 


We  will  now  develop  a solution  procedure  for  solving  P4  and  then  show  that  the  optimal  solution 
so  obtained  also  satisfies  (17).  Hence  the  i >i  mal  solution  to  /■’4  so  obtained  is  also  an  optimal  solution 
to  problem  P2,  the  original  problem  we  ut  to  solve.  For  ease  of  presentation  of  the  solution  pro- 
cedure, we  dehn"  the  problem  PS',  which  is 


Min/'=  2:  2 '0^0  ^ 2 

itl’  Jf.r  iti' 

over  constraint  set  (13)— (16).  The  optimal  solution  to  P5'  is  also  optimal  to  P4'.  withZ'=a'  'Z'. 
3.2.  Solution  Strategy  for  Solving  P5'  (and  P4') 

Each  P5'  is  a capacitated  transportation  problem  with  upper  hounds  only  on  the  (n  + 2)  column. 
The  objective  function  of  a subprohlem  P5'  is  similar  to  the  others.  Further  the  requirement  vector  or 
rim  condition  [6.  7]  of  a P5'  differs  from  P5'  ' by  amounts  of  rj  for  jd"  (i.e..  h'^  = h'j  ' + 8r'  lor  jd" 


since  bj  ' = ^ r]  and  8=  1 ). 


KM’W^ION  ANDSmi’MKM  1M.A\NI\<. 


With  respect  to  the  transportation  tableau  * of/'5'.  it  may  he  rei  alled  that  acellt/'.y)  is  an  ordered 
index  pair  witli  it!  ' ,jej  " . A basis  B is  a set  ol  ( m + 1 ) + ( n -f  2 > — 1 cells  without  cycles  and  such  that 
there  is  at  least  one  cell  in  each  row  and  each  column  |5|.  I-el  it,  and  f;  he  the  dual  variables  associated 
with  B.  A basic  optimum  solution  B"  to  Z'S"  can  h*‘  lound  by  usint:  any  standard  capacitated  trans- 
portation al^'orithm  |5|  or  more  efhcieiitly  by  ii'^int!  the  procedure  suj:nested  in  |8],  h'or  each  /.  /'S' 
can  be  solved  parametrically  starting  Irotn  the  optimal  solution  t<t/'S'  ' by  utilizing  the  area  rim  opera- 
tor 5R|  (/')  [6.  7],  This  operator  transiornis  the  optimum  solution  of  problem  B into  that  of  a problem  of 
B ' whose  data  are  the  s nne  as  that  of  B except  that  = /»,  -f  and  b'^  = bj  + f>j3j.  For  f*5',  «[=  . 

le/'  and  fij=  r'^jej".  Hence  letting«,  = ()  for/e/'and  /ij=r'for  jej”.  /'S' can  he  solved  by  applying  1R| 
(f"  ' ).  The  optimum  solution  to  BV  is  the  same  as  the  optimal  sidution  to  /'S',  with  value  of  the  objective 
function  Z'=  or' 

Vie  provide  below  an  algorithm  to  >olve  ea<'h  BV  successively  lor  I — 1.2 T starting  from 

B".  The  first  phase  of  the  algorithm  determines  an  optimum  basic  solution  to  BV'.  The  second  phase 
applies  the  are^  rim  operator  to  tind  the  optimum  solutions  to  BA' . leK.  e denote  by  if/  the  set  of  cells 
U,j)  which  have  their  respective  bounded  from  above.  From  (IS). 


'F  = { (/',  ti  + 2)  for  /e/'l 


I.et  'F  = ("r  id'  .jd' 


Since  only  the  cells  in  'F  are  bounded  from  above,  we  can  somewhat  simplify  the  statements  of 
the  algorithm  in  (6.  7|  for  applying  SR  i(/'l.  This  simplified  version  is  given  below  and  illustrated  with 
an  example.  The  reader  shouhl  refer  to  |6.  7|  for  the  proofs  involved  in  Phase  II. 


3.3  ALCiORITHM  1;  Parametric  Procetiure  for  Solving  I’rohleni  P4. 


Phase  I;  For  finding  a basic  optimal  solution  to  BA". 

STEP  I:  S(dve  PS"  using  any  standard  capacitated  transportation  procedure  |S|  or  the  procedure 
suggested  in  |8|.  Kecord  the  B",  .V"  - {.v,,"},  u,"  for  id'  and  if’  for  ye,/’'.  These  are  the  optimal  primal 
stdutions  to  BA"  as  well.  .Also  record  Z".  Set  Z"  = /"la. 

PHASE  II:  For  applying  SR  i(/'i  to  solve  BA',  itK. 

.STEP  2:  Set  / = I . /.  = I . //'  = B".  .V;  = .V".  Z/  = Z".  u,.',  - //,"  for  id',  i,.',.  = r"  for  jd". 

.STEP  .'f:  Set  //,  = r',  for  jd'  ■ Find  the  modification  matrix  |6.  7|,  F=  {>•/,}  assc./iated  with  /j, 
for  jd"  and  B'l.  by  solving  the  following  eifuations: 


^ > j,  = 0 for  ie/'. 


^ > <j  - Bj  Tor  jd  " and 

ill' 


* The  reader  is  assumed  lo  he  familiar  wilh  the  ii*>ual  detinitioiis  in  the  primal  alptrilhm  tnr  the  tran‘'>p<»rtati<m  prohlem  |5|. 
Kor  continuity  the  nece''sary  delinitions  >\ill  he  slated  hrietly  when  ihev  are  needed. 
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y,j  = ()  (or  U,j)  4 B'l,. 


Determine  /ni , the  maximum  extent  to  which  the  basis  preservinf:  area  rim  operator  6R.<(A’)  can  he 
applied  using  Equation  (30)  of  |6|,  i.e. 

(22)  fj.\  = Min[(-x,j,A  )/>ij|  for  { (i,  y)€’i'|  v,j  < 0} 

Record  (r,  s)  as  the  cell  at  which  the  minimum  of  (22)  is  taken. 

t 

STEP  4:  (i)  If  ^ m!  ^ 1,  go  to  Step  4 (iiil.  Otherwise,  go  to  Step  4 lii). 


(iij  (a)  Set  ij  = h'j-'  + 

'(*1  ' 


and  A"!! . I = {xij.'i.  . i = Gj.'/.  + >.>o} 


(b)  Delete  the  cell  (r,  s)  from  fi[.  If  there  are  no  basis  cells  in  row  r,  define  /^'  = r.  J"  = <t>.  /,'  = 

I'  ~ {r},  J'J  = J".  Otherwise  imagine  the  remaining  basis  cells  to  be  connected  by  horizontal  and  vertical 
lines  whenever  two  of  the  cells  lie  in  the  same  row  or  column.  Dehne  I'r  ami  7r  those  lines  (rows  and 
columns)  that  are  connected  to  row  r.  Set  I',  = I'  — = J"  — J'/-* 

(c)  Determine  A and  the  cell  (e,/)  where  the  minimum  is  taken  (Equation  (58)  of  [7])  via:  + 


Mcij  - Ui.'A  - Cj.V)  for(f,y)€[/' X7"]  n 4' 

1 (Ui.V  + I’j.'a  ~ Cu.A  1 for  (i,7')e[/r  xyyj  (^  X 


Set  Bi  ^ , = — ir,  s)  + (e,/). 

(d)  Determine  the  duals  u,.V  ♦ i forie/'  and  Vj.'i.  . i for  jej"  using  E()uation  (60)  of  [71.  i.e. 


_ I u',i.  — A for  ie/J. 
1 «!.*  for  ie/.< 


A iin  jd'r' 

v],k  for  >£./.«’ 


.Set  /■=/•  + I,  go  to  Step  (3). 


*F’nr  a mor<*  rigorous  definition  of  these  sets,  see  (61. 

+ It  will  be  proved  later  {Theorem  1)  that  \ for  i«/'  is  mmincTeasing  as  a function  of  the  number  <tf  applications  of 
Steps  (3)  and  (4).  Since  in  x,!n-  i for  ie/'  is  the  only  set  of  varialdes  with  upper  liounds.  t,,.V  . i 0 always,  and  K({uation 
(58)  of  (7j  applies. 
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(iii)  Set 


Mi 


= 1 - m!-  i'orJd". 


Z'F ' 

"l-.A 

ior  iel ' . 

lor  jd"  ■ 


'+(u')yn!  -X!.  . ^ 

Fiiul  ‘J-k.  1 I - \ 11/  > 7’,  {lo  to  Step  5.  Otherwise 

a'  , . . Reeora  them  as  ,V'  and  /'  respeet.vely.  Set  , _ , + 1 . /•  I • H / 

“step  5:  it',  i->r  ^ = • ^ 


T 4 A Numerical  Example  _ „ _ 

show  a P5".  /’S'  and  /’S-  respectively  lor  n ^ li.e.  or  m 


Fiirure  1(a),  ih),  and  (cl 
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Pi/;,  fl|.;  1,  Numerical  rxainpU*. 
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f 

l 

i 


f 

f- 

ir- 


and  T=2,  with  Cjj  — a'  'c,j,  where  cij  and  c,-;  are  the  cost  coefficients  for  f*4'  and  PW  respectively), 
and  let  tv  = 0.8.  Note  that 

“ S O'  = 2 Oi  = 2 '■i  = X 

u7  J(J  7 = 0 r t»  tU 

Also, 


r<‘  = 3.\'  + 


r\  = 3N  + 


r]  = ;iV  - 120, 


ri  = 3N  - 120  - 40. 


In  Phase  I of  Algorithm  1,  using  the  primal  transportation  algorithm  |5],  we  obtain  the  optimum 
solution  to  P5"  as  shown  in  Figure  1(a).  The  circled  cells  denote  optimum  basis  B"  and  the  amounts 
are  shown  in  the  northeast  corners  of  the  cells.  Z"  = 530,  Z"=  (530/0.8)  = 662.5. 

In  Phase  II  of  Algorithm  1,  we  set  ^ 1,  f = !,/!}  = B".Z\  — Z''.Ui,'i  = /t"  for  ie/'  and  Vj.'t  = 

Vj  for  JfJ".  Figure  2(a)  shows  the  modiheation  matrix  F = {yij}  obtained  by  applying  .Step  3.  fi\  = 


Min 


■40  30- 
.20' 60. 


1/2.  Thus  (r,  si  = (2,  3). 


In  Step  4,  since  fi\  < 1,  we  go  t<»  Step  4(ii)(a).  Now  fcj  = 6j’+ /8j/2  for  je.l  ",  and  -^Ij  ,■>  — x'j  ^ + 
(1/2) yij.  These  are  shown  in  Figure  2(b).  It  can  he  verified  that  = 810.  From  Step 4(ii)(b),  11=  {2,1}, 
/i=(3},y"={2,  )},y}'=(3,4}.  From  Step  4(iiXc),  we  find  that  A = Min [,W  — 10,  ;Vf  — 9,  —1+5, 
1 +2]  =3  and  (e,  /)  = (2,4).  B\  = B\  — (2,  3)  + (2,  4).  I sing  (24)  (Step  4(ii)(d)),  we  obtain  the  u]  and 
vj^.j  for  ie/'  and  Jej"  as  shown  in  f igure  2 (c).  Applying  Step  (3),  we  obtain  the  modification  matrix 


y = {y-jj } as  shown  in  Figure  2(d).  We  have  fi\  = 3/2,  (r,  s)  = ( 1, 2).  In  Step  4 since  ^ //j  > 1 we  go  to 

i I 

Step  4(iii),  where  we  set  p,.}  = 1 — 1/2  = 1/2,  and  hj  = b'J+  rj  Utr  jeJ  " . B'  and  A"'  are  as  shown  in  Figure 
2(e).  It  can  be  verified  that  Z.J  = 1,180.  Hence  Z'=  (0.8)“(  1 ,180)  = 1,180.  e now  have  the  optimum 
solution  to  P4'. 
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I’niceeding  alon}:  similar  steps,  startiii(>  from  B\  we  obtain  the  optimum  solution  to  with 
and  X'^  as  shown  in  Fifture  3(a).  Z'^  = (0.8)  [ 1 ,680]  = 1 ,344.  The  optimum  solution  to  /^4  is  .V'  and  A''^  with 
Z = Z‘+Z^  = 2,524. 
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(>,.V  arr  markiMt  in  tin-  nnrtln-ast  i-nrm-r  i»t  tin-  rrtls. 


Km.I'RR  .'t.  Optiniiiiii  Milulion  to  l^\~. 


3.5.  Equivalence  Between  P4  and  P2 

\\  e note  below  a key  property  of  Aljkorithm  I. 

rHKOREM  I:  (i)  The  values  of  .vf,„  obtained  on  the  application  of  Steps  (3)  and  (4)  form  a 
nonincreasiiifi  function  of  k fttr  a particular  t. 

(ii)  The  values  of  .r!  „ , in  X'  form  a nonincreasiii};  function  of  t. 

I’KOOF:  (i)  For  a particular  t,  by  Step  4(ii),  .vj ^ , + ( Ml;  ).Vi > where  )'=  ( Vi , } is  computed 

in  .Step  ,3  for  t and  k.  We  shall  show  that  yi.n-i'^O  for  /j/'.  Assume  the  contrary,  i.e. 

(25)  3 a .Vi«. II . -j  > 0,  /iic/'. 


Froind*))  2 y,„j  = ().  hence 


(26) 


3 <>•  h^J"  - {«  + 2}. 


Hut  Itom  (20)  ^ .Vi.j , = )3j  = r' I 0 hence, 

it  I' 


Hut  ( torn  1 10)  ^ Vi,.,  =0  hence, 

j.,/" 


(28) 


3.Vi,.,,<0, 





KXPANSION  ANt»  .^lUrMKNT  H1,ANNIN(; 


49 


!f7;!  = {n  + 2} , the  cycle  { ( to,  n + 2).  (i  . / 1),  (<1,^1),  (j'i,  n + 2) } has  been  detected  in  B[.  which 
is  a ccntrad!ctiii!i. 

if  { « I 2} , since  > 0 

(29)  >9,  t2c/'- {i«}  - {ii}- 

since  if  i>=  i»,  the  cycle  {(t«,  jt).  (it,  jt),  (it,  ji),  («o,  ji)}  has  been  detected  by 
(26)-(29),  contradicting  the  fact  that  H[  is  a basis.) 

We  are  then  back  to  (28)  with  a 

< 9,  J:ttj"  -{jt}  - {/i}. 

(Again  j-,t^  jt  since  if  j:i=  jt  a cycle  has  been  detected  in  B[.) 

Since  /'  and  ,/  " are  finite,  inductively,  we  must  terminate  with  ;he  existence  of  a 

(30)  2 <9. 

Conditions  (23)-(30)  imply  the  existence  of  a cycle  in  fij , which  is  a contradiction.  Now./ij^  ^O. 
hence  we  have  .r|,„ . 2,a-  n '1,n , 2,a  f"'’  • 

(ii)  For  a particular  t and  k,  by  Step  4(iii) 


By  Theorem  l(i).  we  have 


= Y f ^ =r  ^ whprp  / ^ I 

'^1.  n » 2 ^1,  n *-  '2,1  n ♦ 2,  I •*!.  n ♦ 2 ‘ ‘ - 


Q.E.D. 


REMARK  1:  By  Theorem  i;ii).  Algorithm  I provides  an  optimal  solution  to  F*4  with  x[  a 
nonincreasing  function  of  t.  for  ic/'.  Consequently,  the  coupling  constraint  (17)  (which  is  equivalent  to 
(4))  is  satisfied.  Therefore,  the  optimal  solution  provided  by  Algorithm  1 is  also  an  optimal  solution  to  the 
linear  capacity  expansion  problem  B2. 

(.’ontinuing  on  the  numerical  example  in  section  3.4,  we  find  that  g‘/=  (/I  = <ff  — 0.  gS=0.  g.{  = 30. 
g'{  = 70.  Hence  the  optimal  solution  A"'.  X-  is  also  an  optimal  .solution  to  the  problem  B2,  formed  by 
adding  the  coupling  constraint  qj  -qj  ‘ > 0 for  f = 2,  t = 1 , 2 to  the  numerical  example  given  in  Figure  1. 

REMARK  2:  Algorithm  1 provides  an  optimal  solution  to  B2,  by  solving  parametrically  (in  terms  of 

the  rim  conditions)  T+l  transportation  subproblems  B4‘.  t = 0,  1 T.  Since  the  computational 

times  for  such  large  subproblems  (e.g.  25  x 500)  are  only  a few  seconds.  Algorithm  1 can  provide  an 
optimal  solution  to  fairly  large  size  problems  F2  (e.g.  1 = 23,  J = 500  and  T = 10)  in  a matter  of  seconds. 
However,  as  stated  before,  a problem  B2  os  such  size  may  be  computationally  unwieldy  for  linear 
programming  codes. 

REMARK  3:  In  converting  problem  B\  to  1*2  we  assumed  that  gi=  kt  for  i«/.  We  show  below  that 
this  assumption  can  be  somewhat  relaxed.  If  kt  ^ then  the  expression  ' [a  ( Ay  — /sr,)  ]qf  will  have 
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to  l)e  added  on  to  the  ohjective  tiinetioii  l7l.  In  teriii'-  of  the  |>roldem  /'fi  llii'  aneet>  onl>  ' in  wliieli  the 
eosts  <1  „ , change  to  r l,„  . ■>  wliere 


In  terms  ol  llie  operator  theory  of  parametri<'  programming  [fi.  7|  ihi'  i'  referred  to  as  the  area  cost 
operator  S(li(/^)  which  tran-lorin'  tin-  opiiiiuiin  'ohilion  ol  /'to  that  ol  I’'  with  the  -amc  data  except 
c,'^  = Cj , 4- 6-y, , for /e/  and  /« ./ . In  our  |irol»lcm  A = I . y,  „ . — a i — g,  I for/t/  and  y,  0 eUe- 

w'here.  1-et  the  maximum  extent  to  which  i if*)  can  he  applied  without  altering  the  current  basis 
structure  he  /ai.  I hen  il  /a  i * I ihcti  IV  i-  al-o  optimal  to  ihi'  changed  «ct  ol  co«t-.  Ilowcxcr  il  /a  i ■ 1 
then  lurther  application  ol  the  operator  iiuolve"  hasi'  changes  and  the  solution  «o  obtained  lor  f>=  I 
may  not  satisfy  the  ( onstraints  1 1 7 1.  Howexer.  lot  a reasonahK  long  planning  hori/.on.  even  in  the  latter 
case,  the  solution  obtained  with  the  a-"Umplion  I. , f:,  may  he  expected  to  he  nearly  optimal  to /'I. 

(!ontinuing  on  the  example  from  section  .f.4  we  have  /, , = ')/ll.l.’=  25  and  /. _■  - 10.  Let  gi  2.5  and 
gi  = 0.  Hence  we  have  y i .4  = — (0.8 1(2  I = — 1 .6.  y^.  4 = — O.K  and  y, , =0  for  the  remaining  cells.  .Apply- 
ing I'heorem  8 of  [6  | , we  obtain  the  // ’ lor  i < / and  1 ’ lor  jtJ  " as  shown  in  h igure  .5ihi.  The  maximum 
extent  to  w Inch  the  hC  1 ( /'  1 can  he  a[iplicd  i-  ivee  K.ipiatioii  1 K)l  of  (6  | ) 

fji  ' = Mini  1 U - 1 - 12)  0.8.  I 1/  1 II  ) '0.8|  1 U-  1.51  0.8 

Hence  the  (primal)  optimal  solution  a»  given  in  Kigurcs  2iei  and  .5ia)  remains  opOmal  to  l'\  with  gt  - 2.5 
and  g-  - 0 as  well.  In  fact  for  this  example,  the  optimal  solution  remains  opnmal  to  l'\  forOsJ  g,  Si  /, , 
and  0 « g.j  -s  /,  j. 

4.0.  on  IMALITV  I'ROPKRTIKS  AM)  INUMTK  I’LANMNC;  IIORI/ON 

4. 1.  Properties  of  the  Optiniul  .Seliition 

In  this  section  we  study  some  properties  of  the  optimal  solution  to /'2  as  provided  by  Algorithm  1. 
LEMM  A 2:  In  the  optimal  solution  to  /'2  as  provided  by  Algorithm  1- .vj  1 = v [ 1 1 - 0 lor  all 

/e  {t.  T + I 7 } if  </I  d ( "-  V [ „ ■ \ I lor  anv  rt  A .ind  it/’. 

PHOOK:  Assume  the  contrary  , i.e.  .vj  > 0 for  a /t  ( t.  r + I 7’ } . 

By  Theorem  lliii  q\  ? </[  0.  The  value  of  the  ohiective  function  to  snhprohlem  l‘l'  can  he  reduced 

by  decreasing  .v[  (‘  decreasing  i|  „.,)  and  decreasing  ( imrea'ing  v [ contradicting  the  fact 

that  .r[  „ , I and  vj  „ . belong  to  an  optimal  solution  of  I’V. 

The  physical  interpretation  of  Lemma  2 is  intuitively  meaninglul.  It  savs  that  with  linear  costs, 
there  exists  an  optimal  solution  to  7'2  such  that  if  there  is  a capacity  addition  in  a period  lor  some 
region,  then  that  reg  i full  capacity  v.ill  b*-  iitili/ed  for  that  period  as  well  as  all  future  periods. 

f 

I.EMMA5:  if  and  ^ r’  are  integers  for  it/.  /«./  andrefO}  ■ /v . the  optimal  solution  (o  7'2  as 

T ^ n 

provided  by  Algonlh.ai  1 arc  also  inte(<rs. 

I I ! 

PROOF:  ^ /'  I and  ^ ’'I,.-,  or /»{()}  • K involve  additions  and  subtractions  of  f/|' and  ^ r' . 

• (1  : II  : II 

It/.  / 1 ./  and  / e { 0}  ■ K.  .Also  by  deiinllion.  q“,„  . , — 0.  Sioe**  .V  can  also  be  assumed  to  be  an  integer,  the 
rim  conditions  of  /'4'  (see  il5l-(15l  i.e.,  <i”  and  /»',  lor  id  and  /t./  . It  {•)}  + A ) are  all  integers.  I'he 
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constraint  matrix  of  each  subproblem  P\‘.  (c  {0}  + A.'  is  totally  unimodular.  AppUcation  of  Algorithm  I, 
therefore,  produces  integral  A'  for  A.  By  Remark  1,  this  integral  solution  is  optimal  to  P'1. 

Lemma  3 is  interesting  because  the  constraint  matrix  of  P'l  is  itself  not  unimodular.  In  the  physical 
context  of  the  problem,  integral  optimal  solution  may  be  important,  since  it  may  be  meaningless  to  add 
a nonintegral  number  of  capacity  units.  In  the  multiperiod  assignment  problem  mentioned  in  section  1. 
this  may  be  particularly  important. 

LEMMA  4;  li)  Assume  r'j  >0  for  jfj  For  some  t and  A.  if  at  Step3  of  Algorithm  1,  the  modifica- 
tion matrix  F = {yo}  obtaining  by  solving  (19)-(21)  has  y^,  > 0,  for  then  fi'  = Z,  (a  large  positive 

number). 

lii)  The  B'  = B\  . , derived  from  the  subsequent  application  of  Step  4(iii)  remains  an  optimal  basis 
for  all  subproblems  P\\  t ^ 

PROOF:  We  have  ^ 0 forte/',  jej  ' . Using  equation  (22)  we  hav  * 

Min(-xi  ^ )/yi.,»i  for  { (t,  > )e'F|y,j  < 0} 

Since  the  set  of  minimization  is  empty, /ij  — L (a  large  positive  number) 

(iii)  The  Y=  {>ij}  satisfy  (19)-(21).  Since  n'^=L,  from  Step  (3)  we  go  into  Step  4(ii)  where 
= is  obtained.  At  the  next  application  of  Step  3,  we  can  obtain  a new  modification  matrix 
satisfying  ( 19)-(21 ) by  defining  Vjj  = (r^* '/'‘j  ).Vi;  for  le/'.  ye./ ' and  y,  „•  j=  - ^ y,j  for 

]tj‘ 

ie/'.  Since  rj  > 0,  yy;  s Ot  and  r'  * ' >0  for  ie/',  jij  ',  we  have  ^ 0 for  ie/’.  jtj  '■  Y thus  satisfies 
the  condition  of  Lemma  4(i)  and  /i'  * ' > 1.  Hencefl'  ’ ' = B'.  The  argument  can  be  repeated  to  show  that 
B’  = B'  for  T ^ 

Lemma  4 provides  a sufficient  condition  at  which  Algorithm  1 can  be  terminated,  since  when  this 
condition  has  been  attained  at  time  t (say),  an  optimal  solution  to  all  PV.  r ^ t can  be  readily  obtained. 

An  optimal  solution  to  P2  is  given  by  B',  B‘ B'.  B'*'~  B' B^=  B'.  and  A A'^ V'. 

A'*'  = A'-)-F'*',A'*^  = A'*'  + F'*‘ A^=A’‘‘'-)-F’^.  (F'*'is  the  modification  matrix  obtained 

Ly  solving  ( 19)-(21 ) with  B,=  r'j"  lor y>7  ) 

4.2.  Infinite  Horizon  Case 

We  now  show  that  Algorithm  1 can  be  applied  to  solve  Pi  with  an  infinite  planning  horizon.  Obvi- 
ously, m the  infinite  horizon  case,  the  assumption  regarding  the  resale  value  of  the  capacity  at  the  end 
of  the  planning  horizon  is  not  needed.  Infinite  planning  models  have  received  interest  e.g.  [3,  4]  as 
it  is  felt  that  any  terminal  condition  imposed  on  a planning  model  is  arbitrary. 

We  assume  that  for  periods  prior  to  T,  the  demands  in  each  market  can  be  estimated  with  greater 
accuracy.  Hence  the  growth  rates  for  these  periods  may  be  any  nonnegative  rate.  At  the  end  of  the 
planning  period  T.  the  demand  in  each  market  y is  estimated  to  grow  at  the  rate  Bj  P^f  period.**  .After 


*If  rj  = 0 for  any  j€y  Irl  r'  = «,  wtierr  c is  a very  sma)l  positive  number. 

t It  can  be  shown  easily  that  since  y, j » 0 for  i «/ ' . y t y ' . there  can  exist  one  and  only  one  y, j > 0 for  each  jtJ  ‘. 
• * From  the  definitions  given  in  Section  3. 1 . we  have^>.  i = 0 and  — ~ 
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solving  /■‘4'  tor  i up  to  T.  llie  remaining  prolilein  in  an  infinite  horizon  model  consists  of  the  suhprol)lenis 
/'4'  for  / > T whe.. 

I T 

/)'=  ^ X ^ ~ ^ ^ Jf-I  - 

r n r U 

It  is  obvious  that  there  exists  a basic  leasihie  solution  to  any  suhprohlem  /'4'.  for  I ^ 0.  Kach 
/'V  is  an  e(piivale!it  problem  to  the  others  except  for  the  requirement  vector  [5],  which  is  a nonde- 
creasing function  of  r Hy  a well  known  result  in  parametri*'  programming  [5.  p.  !4y|.  there  exists  an 
optimum  basis  H'  to  /'4'  which  remains  optimal  to  all  I’V.  I ^ t. 

Algorithm  I can  he  applied  to  >olve  /^4’,  / ^0  until  the  niodificalion  matrix  } las  computed  in 
Step  3)  -atisfies  the  condition  of  l.emma  -t(;).  Assume  thi-  is  ai’hieved  at  t=/i.  A basis  /f'l  has  been 
obtained  whii  'i  remaitis  optimal  to  all  /'4'.  I ^ ti.  An  optimal  -olution  to  I'V . !>l\  is  given  by  \'  = 

V'  ' Hv  I.entma  4.  W'. /f- H'>.  = H'> . . . .I{'  = li'i  is  an  optimal  solution  to /'I  for 

the  infinite  hori/.on  case. 
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ABSTRA(T 

A l.iiu  ai  Kiactional  Inh  rval  Pro^rariiiiiinK  prold<*ni  jKIP)  is  thr  prohirm  of  t'xiroini/jng  a 
linear  frai  lioiial  fumiion  >itli}ect  to  two  sitfed  linear  intMjuality  constraints. 

In  'his  {japcr  we  (ievelup  an  algoritlim  for  solving  (KIP)  jtrohlcms.  first  apply  the 
('harnes  and  (hooper  traM'^formation  on  (KlIM  and  then,  hv  exploiting  tlu‘  special  •'trueture 
«d  the  pair  o|  1 Pi  ptohlems  derived,  the  algorithm  produces  an  i»ptimal  solution  to  (KIPi 
in  a tini(t‘  niirnher  o|  iterations. 


i.  INTRODUCTION 

Pnil)lt*ms  (if  maxiini/.ing  a linear  Iractiona!  nlijective  lunotion  subject  to  two-sided  linear  inequality 
constraints  were  termed  in  the  literature  as  I'ract'onal  interval  programming  problems,  denoted  by 
(FIPl.  Their  general  formulation  is 

Max  (c'.r  + c«  ) / {<Px  + r/»  ) 
subject  to  h ^.4x^1)' 

\A  e remark  that  for  a suitable  choice  of  the  vectors  h and  h'  the  constraints  set  of  iF'lP)  is  sufficiently 
general  to  cover  all  bounded  polybedral  sets. 

Problems  with  linear  fractional  objective  function  ai  e.  e.g.  in  attrition  games  (14],  .Markovian 
replacement  problems  [11.  15).  n ‘iluction  of  integer  programs  to  knapsak  problems  [4].  the  cutting 
stock  problem  [Id),  in  primal  dual  approacbes  to  (^composition  procedures  [1.  16]. 

The  linear  interval  constraints  arise  in  problems  of  capital  budgeting,  blending  and  mixing  prob- 
lems. production  planning  problems  and  more,  see  e.g.  [d.  19]. 


*Thi?'  rc>curch  wa*>  parlidlly  -uppurtrd  hv  NKf!  (irant  iiumhrr  .A-4(*24  and  hy  O.NK  (iunlracl.w  NOOOI4— h7-.A-0I26-()008 
and  NOOOI4-67-  A-0I26-IHHW  with  ihc  (irnlrr  f*>r  fivhiTnrlir  Mudio.  The  Iniversity  nf  Texas. 
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A (-((mpletc  analysis  and  an  explicit  solution  lor  (FIP)  when  the  coefhcient  matrix  /I  is  of  lull  row 
rank  was  first  obtained  hy  Charnes  & (iooper  |7|,  see  also  |5,  I0|.  A finite  algorithm  lor  solviti):  the 
fieneral  (KIP)  pnihlem  directly,  i.e.  without  resortint:  to  the  transformation  of  (FIP)  to  an  e(|uivalent 
linear  pro^'rammin^  prohlem.  was  constructed  in  |9|. 

In  this  paper  another  finite  primal  algorithm  for  solving  iFlP)  is  developed.  In  contrast  with  the 
algorithm  developed  in  |9|,  we  first  apply  here  (iharnes  and  (iooper's  translormalion  |f)|  on  iFIP)  to 
reduce  it  to  a pair  of  (I.P)  pnthlems.  'I'he  crucial  observation  is  that  for  a fixed  value  of  the  additional 
variable  t,  introduced  hy  that  transformation,  each  one  4-f  the  pair  of  il.P)  problems  is  ati  Interval 
Programming  problem  (IP)  which  is  significantly  smaller  in  size.  'I'his  last  feature  is  fully  exploit  in  our 
algorithm  where  instead  of  solving  the  pair  of  (l.Pl  problems  directly . we  solve  |)aramelrically  lor  I 
the  associated  (IPi  pr(»blems  using  the  method  d<-veloped  in  [8]  . ^e  start  with  a feasible  value  of  / 
lor  which  an  optimal  solution  to  the  associated  til’)  pnddem  is  generated.  I’he  values  of  l and  the 
corresponding  optimal  solutions  are  then  miMlified  until,  after  finitely  many  iterations,  an  optimal 
solution  to  iFlP)  is  produced. 

'I'hus,  by  exploiting  the  special  structure  of  the  interval  constraints  and  by  using  the  primal  algo- 
rithm for  (IP)  problems  (8|  as  the  main  device,  we  are  able  to  eflicietilly  -olve  iFlP)  problems. 

rile  algorithm  to  be  described  here  together  with  that  developed  in  I'^l  are  liased  on  two  of  the 
major  approaches  suggested  for  solving  frai'tional  programs  — those  of  (iharnes  and  Cooper  [b]  and 
Martos  [17J.  respectively,  and  they  both  utilize  the  special  structure  of  the  interval  constraints  while 
generating  an  optim.d  solution  to  (FIP). 


2.  PRELIMINARY  RESULTS 

('.(insider  again  the  (FIP)  problem: 


Max 


( ■ ' > * C,i  (.'(.») 

(P  X ■ (lu  IH  x) 


S.t.  »€.S  {/(  S;  ■!««:/)• 


where  r' . Co.  </'.  It  .It'  and  ,•/  are  given,  in  the  sc(|uel  we  shall  assume  that  .S’  is  bounded  and 


(.’l) 


c’ V + c„ 

-77 i ( (.nstant 

(/ ' V ' dll 


on  .S. 


l.EMM.A  1 [7|:  .A  feasible  (FIP)  is  unbounded  if  either  c^  \ (, -I  )-.  or  \ ( 4 )'.  where  \(,4)  is  the 
null  spacr  of  .4. 

i.EM.M  A 2 |9|:  Let  (FIP)  be  given  with  re^  (.4  ) . i/e  V(,4  ) ■ and  -UR ' " w here  /{'"■"  is  the  set  of 
all  m X n matrices  with  rank  r.  Let  l)(Ry"  satisfy 

Ril)']  = H{V) 


Then: 

(a)  ,477'^e/C: 
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(b)  (KIP)  is  equivalent  to  a lull  column  rank  (FIP)  with  coefficient  matrix  AIV  and  cost  function 


c^D^y  + Co 

dw^  + d„  ■ 

(c)  If  feasible,  the  optimal  solutions  of  (FIP)  are  D’’  y*  N(A)  where  y*  is  the  set  of  optimal 
solutions  to  the  equivalent  problem. 

PROOF:  Since  R{4^)  = A(/<)^  and  since  ccS'  A)‘- . dt^(A)^  it  follows  that  every  optimal  solu- 
tion to  (FIP)  is  of  the  form 

,v*-l  \(/4) 

where  .v*  is  an  optimal  solution  to 


(4) 

s.t.  h ^Ax^lr 


xcKiAn 

But.  since  K{A^  ) = K(l)^ ) , xcRiA^  ) can  be  equivalently  written  as: 

V = /)’■>,  yeK^ 

Substituting  jr  = /4'  v in  (4)  results  in  the  equivalent  problem,  which  completes  the  proof. 

.3.  AN  ALGORITHM  FOR  SOLVING  (FIP) 

(Consider  again  the  (FIP)  problem 


(1) 

( C^X  i Co  C{x) 

''“l./'v  + , 4 = />(,) 

(2) 

s.t.  /; 

and  assume  that  (FIP)  is  feasible,  r 1 ^ (/^ ).  d 1 V(.4)  (see  Lemma  1)  and  A is  of  full  column  rank 
representati(»n  (see  Lemma  2). 

Following  Charnes  and  Cooper's  transformation  [6],  we  multiply  C(x)  and  D(x)  by  t,  t > 0,  and 
restrict  I ■ f)(x)  to  be  equal  to  1 (or  — 1,  for  negative  values  i>f  the  denominator).  .Substituting 

(,T)  tX=Z 

in  (1),  (2)  results  with  the  following  pair  of  (LP)  problems,  equivalent  to  (F'lP)  and  denoted  by  (ELPl) 
((E1.P2)) 
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PPPIRliiPliPPli^ 


(6) 

Max  {c^  • z + Co  ■ l} 

(Max  (— c^-z  — Co 

(7) 

s.t.  ,4 

■z^f)'  -t 

(8) 

A\ 

(9) 

<F-z=\-d„-t 

(d^  • z = — 1 — (/o  • 0 

(10) 

():S, 

4/ 

wliere  Af  is  a sufficiently  large  number.  As  it  was  noted  in  |6),  (KLPl)  and  (ELI’2)  differ  from  each 
other  by  only  a change  in  sign  in  the  functional  and  in  one  constraint. 

We  observe  that  the  constraints  of  (EIJ’l)  ((EEP2D  are  of  special  structure.  Indeed,  for  any  fixed 
value  of  t,  the  2m  constraints  (7),  (8)  are  e(|uivalenl  to  m interval  constraints  of  the  form 

(11)  h ■ t ^ A ■ 2^  Ir  ■ l. 

Thus,  for  any  hxed  feasible  value  of  I (EI.Fl)  ((EI.P2))  can  be  reduced  to  an  etjuivalent  (IPl  problem 
denoted  by  (ElPl)  ((EIP2))  of  the  form 


(12) 

Max  c’  • z f 

Co 

• I (.Max  — — r,r  t) 

(13) 

s.t. 

i, 

t^A  z^  b - -t 

(14) 

1 - </„  • t s (/'z  s 1 - du 

■ t 

(-  1 - do  ■ / « d^z  « - 1 -dn  ■ 1 

l.et  x'  he  a feasible  solution  to  (KIP),  not  necessarily  an  extreme  point. 

REMARK  1:  For  a real  world  problem,  a feasible  solution  to  |2)  might  sometimes  be  at  hand  from 
the  available  data  on  the  problem.  If.  however,  a feasible  solution  to  (FIP)  is  not  available  then  v = () 
can  be  chosen  as  a leasible  start  whenever  h « /»'.  Otherwise,  assunting  l>'  ^0,  we  can  solve  the 
following  (IP)  problem 


Max-  l/  e'f 
s.t.  h « 4r-(-/f  </r 

o=s/r«/, 

where  M is  sufficiently  large,  in  order  to  produce  a feasible  solution  to  (FIP).  if  such  a s<dution  exists. 
For  a more  detailed  discussion  see  [8]. 

Clearly.  >0  (/)(  v' ) < 0)  then 


(bS)  i,  = \ll)(x').z'  = t,-x'  U,  = -\ll)(x').z'  = irx') 

is  a feasible  solution  to  (El. PI ) ((EI.P2)). 


t 

I 

i 

I 

\ 

! 
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In  ihf  following,  we  shall  present  a method  for  solving  (El. Pi ) i.e.,  the  ease  that  l)(x' ) > 0.  Exactly 
the  same  method  will  he  applied  htr  solving  (ELP2)  when  /.f(jr')  ''  0. 

The  main  idea  underlying  our  method  is  to  take  advantage  of  the  special  structure  of  (El. Pi) 
while  attempting  to  generate  an  optimal  solution  to  (KIP).  Thus  for  / = /i  we  first  apply  the  primal 
algorithm  for  (IP)  problems,  introduced  in  [8] . in  order  to  produce  an  optimal  solution  z(ti ) . to  (EIPl ). 

Let  B he  the  optimal  basis  generated  by  the  primal  algorithm  for  (IP)  and  ,V  the  completion  of  the 
rows  of  (;]?  ) to  H.  Let  h'  U)  = i'i  ,)  and  h (/)=(''  ,).  and  denote  hy  /<„(t),  l\{l). 

the  partitions  of  the  vectors  h (l) . Ii'  U)  which  correspond  to  the  [>artition  of  T to  H and  A.  respectively. 
Substituting 

(16)  V Bz 

in  (EIPl)  and  rearranging  the  order  of  the  constraints  results  with  the  following  e(iuivalent  problem 


(17) 

Max  {,  ’ B 

' » * r„  ■ 1 1 

(18) 

s.t.  /;„(/)« 

^ «/-;,(() 

(19) 

/<j/)«  v/y  ■ 

% ^ h^U) 

Since  B is  an  optimal  basis,  \ ' given  by 

A^(/,),  if  <•'//, 

liffU,),  ifc'7/|'<() 

is  an  optimal  solution  to  (17),  (18).  ( 19(  for  ( = 6 . and 
(21)  z{(,)^B  ’•/, 


(20) 


II I 


is  an  optimal  solution  to  (ElPlff  for  t = See  also  |2|.  |8|. 

Clearly,  t = t\  is  not  necessarily  the  optimal  value  ot  1 in  1 El. PI ).  In  (he  following  we  shall  generaic 
the  optinial  value  of  t.  and  the  optimal  solution  ;(/'”’')  to  (EIPl  I for  i — I'"". 

Let 


(22) 


if  ( ? 0 
if  < rB,  '<  0 


Treating  f as  a variable  an<l  substituting 


(2.'f) 


V,  = 6/)(f ),  ( / = 1 II ) 


in  ( I 7) , ( 18) . ( 19)  results  with  the  following  single  variable  constrained  maximization  problem 
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(24)  Max  I + Co  • / I -- Max  {a«  • / + )3«} 

(25)  s.L  bsiD^NB  'bH{t)^hiit). 

Since  t = t|  is  a feasiiile  solution  to  (25),  then,  if  a«  = 0 we  can  immediately  conclude  that  (2(/i),  t\)  is 
an  optimal  solution  to  (ELPl).  If,  however,  a«  5^  0 we  need  to  consider  the  following  three  exhaustive 
cases: 

(i)  a«  > 0 and  the  value  of  t can  he  increased  until  M without  violating  any  of  the  constraints  in 

(25) ,  then  C(x) / D{x)  is  not  hounded  overS,  see  [6]. 

(ii)  > 0(a«  < 0)  and  the  value  of  t can  he  increased  (decreased)  from  t|  to  /a,  where  t>  > 
tiiti  < ti)  is  the  largest  (smallest)  value  of  t which  does  not  violate  the  constraints  in  (25). 

(iii)  Any  e increase  (decrease)  in  the  value  of  f when  a«  > 0(a«  < 0)  violates  at  least  one  of  the 
constraints  in  (25). 

Thus,  whenever  a«  = 0 or  case  (i)  occurs  we  terminate  with  the  appropriate  conclusions. 

Assume  therefore  that  we  encountered  case  (ii),  a/j  > 0 and  that  we  had  increased  the  value  of 
t until  ti.  We  shall  attempt  to  vary  the  value  of  t from  ti  so  as  to  improve  the  value  of  the  objective 
function.  Exactly  the  same  method  is  applied  if  case  (ii),  an  < 0 occurs  or  when  case  (iii)  occurs,  for 

t = ti. 

Since  for  each  j,  b‘  (f),  bj  (/)  are  linear  functions  of  t.  they  can  be  written  as 

(26)  V ( M = b;  '■  t + y;  , b-  it)  = bj  ■ t + yj 

For  simplicity,  let  the  nonbasic  constraint  satisfied  as  equafity  at  ti  be 

(27)  «iyi(t2)  + . . . + a„  • y„(f.i)  = b{tj)„^,  = b„^,  ■ li  + y„^, 

where  b(ti) „ n = b*  [ti)  „ , 1 if  the  nonbasic  constraint  reached  its  upper  bound  as  t was  increased  to 
ti  or  b{ti)„f,  = b (ti)„^^  I if  it  reached  its  lower  bound. 

We  shall  refer  to  nonbasic  constraints  satisfied  as  equalities  at  f = fa  as  critical  nonbasic  constraints, 
and  to  f = f2  as  a critical  value  of  f. 

REMARK  2:  We  shall  assume  in  the  sequel  that  there  exists  only  one  critical  non-basic  constraint 
at  t = ti  and  at  any  other  critical  value  of  f.  This  assumption  can  always  be  made,  since  if  not,  a 
perturbation,  essentially  equivalent  to  that  introduced  in  (8]  for  the  linear  interval  programming  problem 
can  be  performed  in  order  to  secure  this  property.  The  perturbed  problem  is  obtained  from  the  original 
problem  by  replacing  the  vectors  b*  and  b by  the  perturbed  vectors  6*  (e)  and  6 (e)  where 

6,(€)  = 6r  + e'  6i  (e)  = 6j  — (t  = 1,  . . .,  m) 

and  e is  sufficiently  small  and  positive. 

Let 

T=  (f;  t is  feasible  to  (ELPl)} 

v(t)  —The  optimal  value  of  the  objective  function  in  (ELPl)  for  teT. 
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LEMMA  3:  T is  convex  and  v[t)  is  concave  over  T. 

PROOF:  The  convexity  of  T is  clear.  Next,  let  /i,  r2€7’  and  let  A,  X be  non-negative  scalars  such  that 
\ -f  X = 1.  Then, 

(28)  t;(Xri  + Xfj)  = Max  {c^  [Xzi+  XZ2]  -f  co[X/i  + X/2] 

*i.»i 

s.t.  6"[Xri  + Xr2]  ^ A[Kzi  + X22]  ^ b'  [Xti  + X?2] } 

? Max  (r^[Xzi  + Az2]  + Co[X/|  + X ■ ^2] 

ii.ii 

s.t.  b it,)  ^ Az,  ^ it,),  b (tj)  Az^  ^ b ' (tj)  } 

= X • Max 

s.t.  /»  (ti)  ^ Az  ^ b*  (h  ) } 

+ X • .Max  {c^2 

s.t.  A (<2)  ^ Az^  b-(t2)}  = X ■ -f  Xr(t2) 

which  completes  the  proof;  see  also  [[12]  Lemma  1]. 

Since  it  can  he  shown  that  (23)  is  optimal  to  ( 17),  ( 18),  ( 19)  for  ^ € 12.  then,  as  a corollary  to 
Lemma  3,  we  have  the  optimal  value  of  t in  (ELPl)  is  greater  than  or  equal  to  t ’. 

The  feasible  solution  (y(t2).^2)=  (ytU'z) Vnl/i).  ti)  is  an  extreme  point  for  (18),  (19)  in 

R"  * '.  In  the  following,  we  shall  generate  an  adjacent  edge  to  (y(t  >).  !■>)  along  which,  by  increasing  the 
value  of  t we  shall  improve  the  value  of  the  objective  function  (if  such  an  incident  edge  exists). 

Suppose  we  form  a new  basis  by  removing  8;,  the  ^th  basic  constraint,  and  inserting  the  criti'^al 
nonbasic  constraint.  Then,  upon  substituting  the  new  set  of  values  of  the  vj's  (as  it  was  done  in  order  to 
obtain  (24),  (25)),  we  can  calculate  the  slopes  of  the  objective  function  and  the  constraints,  as  func- 
tions of  f,  in  the  new  basis. 

Denote  by 

6=The  current  basis. 

Bj=BI  The  yth  basic  constraint  U the  critical  nonbasic  constraint,  where  / denotes  deletion 
and  U denotes  union. 

a«=The  slope  of  the  objective  function  in  the  current  basis  B. 

QHj=The  slope  of  the  objective  function  in  the  basis  Bj. 

Sin  i=The  slope  of  the  critical  nonbasic  constraint  in  the  basis  B. 

Sf=The  slope  of  the  jlh  basic  constraint  in  the  new  basis  Bj. 

Then  it  is  easy  to  verify  that 
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. 


f 

t 


<■ 


We  conclude  therefore  that  if  U,)j<  l>lfUi)j  and  either 

(31 ) (/<«))=  ««j  > 0.  Sj  ^ (h„)j 

or 

(32)  (/>«))=  (/*/t)j,  oiHj  > 0,  Sj  « 

then  we  can  increase  the  value  of  /,  without  violating  any  of  the  nonhasic  constraints,  and  thus  improve 
the  value  of  the  objective  function.  If  ir  the  )th  basic  constiaint,  /)„(/2)j=  we  shall  attempt  to 

remove  that  constraint  from  the  basis  only  if.S,=  (/'/,  )j=  (^«)j  ^ 0. 

Thus,  if  possible,  the  value  oft  will  he  increased  until  its  next  critical  value,  i.e.  the  largest  value 
that  t can  he  assigned  without  violating  any  of  the  nonhasic  constraints. 

THEOREM  1:  If  for  each /,  0=  l>  • • ••”)  neither  (31 ) nor  (.32)  are  satisfied  then 


(33) 


(Z(t2).  h) 


I 


I 


f. 

i- 


i. 


is  an  optimal  solution  to  (El.Fl ),  where  z(t_.)  = H '>(/j). 

PROOF:  Replacing  a basic  constraint  with  the  criti<  al  nonhasic  constraint  and  attempting  to 
increase  the  value  of  the  objective  function  through  an  increase  in  I.  amounts  to  examining  the  pos- 
sibility of  improving  the  value  of  the  objective  function  by  moving  along  an  incident  edge  to  (vita),  O). 
Since  any  such  attempt  failed,  and  since  yU-^)  is  an  optimal  solution  to  (17),  (18),  (19)  for  t=  I:  we 
conclude  that  none  such  incident  edge  <*xists,  whi<  h implies  that  Olt^).  t-i)  is  an  optimal  solution  to 
(17),  (18),  ( 19) , and  thus  (R  ' • yUi),!-,)  is  an  optimal  solution  to  (ELPI ). 

As  we  noted  earlier,  we  maintain  an  optimal  tableau  while  increasing  lor  detreasing)  the  value  of 
t from  /i  until  t>.  Explicitly,  for  each  / € [ti,  /j],  (23)  is  an  optimal  solution  to  (17),  ( 18) , (19).  How- 
ever, this  property  does  not  generally  hold  as  we  move,  according  to  our  criteria,  from  one  extreme 
point  to  an  adjacent  extreme  point  by  varying  the  value  of  t.  Therefore,  whenever  we  reach  a critical 
value  cf  / we  need  to  check  the  optimality  of  the  current  basic  solution.  If  it  is  optimal  we  try  to 
improve  the  value  of  the  objective  function  by  moving  along  one  of  the  incident  edges  to  the  current 
basic  solution.  If,  however,  the  solution  is  not  optimal,  we  first  apply  the  primal  algorithm  for  (IP) 
problems  in  order  to  generate  an  optimal  solution  for  that  critical  value  of  t. 

Algorithm  A for  solving  if'lP)  is  co:iveniently  summarized  in  the  following. 

ALGORITHM  A. 

Step  1:  Generate  a feasible  solution  ,v'  to  (FIP)— from  which  obtain  by  1 15)  a feasible  solution  (z',  ti) 
either  to  (El. Pi ) and  then  set  i = 1 or  to  (E1.P2)  and  then  set  / = 2. 

Step  2.  Fix  the  value  of  t at  its  current  value  and  solve  (El, Pi)  by  the  primal  algorithm  for  (IP)  problems. 

Can  the  value  of  t be  modified  (i.e.  increased  or  decreased)  without  violating  any  of  the 
constraints,  which  will  result  with  an  improved  value  for  the  objective  function? 

No,  a;i=0— terminate  with  an  optimal  solution  to  (ELPi),  go  to  step  5. 

No,  an  5^  0— go  to  step  4. 

Yes  — go  to  step  3. 
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Step  3.  Can  the  value-  of  l l>e  increased  t<»  M without  violating  any  of  the  nonhasic  constraints? 

Yes— terminate,  with  the  conclusion  that  C(x) I D{x)  is  not  hounded  over  .S. 

No— Increase  (or  decrease)  the  value  of  /,  whereas  the  values  of  the  >/’s  are  modified  accord- 
ingly, as  it  was  done  in  until  an  additional  nonhasic  constraint  is  s.itisfied  as  equality, 

i.e.  until  the  next  critical  value  of  t. 

Do  the  Vi's  satisfy  the  optimality  criterion  for  the  current  value  of  r? 

Yes  — go  to  step  4. 

No-go  to  step  2. 

Step  4.  (iheck  whether  hy  removing  a basic  constraint  and  inserting  a critical  nonhasic  constraint  the 
value  of  the  objective  function  can  he  improved  hy  modifying  the  value  of  t. 

If  impossible- terminate  with  an  optimal  solution  to  (ELPi).  go  to  step  5. 

If  possible- perform  the  appropriate  basis  change  and  go  to  step  3. 

StepS.  Are  the  optimal  solutions  to  (ELPI  )■  and  (EI.P2)  at  hand? 

No  — find  a feasible  solution  (;',  ti ) to (ELPj) /ej  1,2})?^  i,  set  i = j,  go  to  step 2. 

Yes-  Let  (zU"'"),  and  (2(a;”’'),  t""')  he  optimal  solutions  to  (ELPI ).  (ELP2),  respectively. 

if  ^'■[2(0 ] + c«  • ^ [z(  ) ] -f  f„  • C' 


if  rr[2(f"‘>')  ] + c„  • tT  3=  [2  (/;””)  ] + Co  • t"'^' 


Then 


(34) 


is  an  optimal  solution  to  (FIP). 


4.  OPTIMALITY  AND  CONVERGENCE 

The  finiteness  of  Algorithm  A stems  from  the  finiteness  of  the  primal  algorithm  for  (IP)  and  from 
the  fact  that  while  we  move  from  one  extreme  point  of  (ELPi)  i = 1 . 2 to  an  adjacent  extreme  point  we 
strictly  increase  (in  the  perturbed  problem  if  nec«-ssary,  see  remark  2)  the  value  of  the  objective  func- 
tion. Since  the  number  of  extreme  points  is  liniti*  so  is  Algorithm  A. 

ivLMAKK  3:  Let  B be  an  optimal  basis  and  >(/*)  an  optimal  solution  for  (17),  (18),  (19)  for  t=  ti,. 
Assume  that  at  t = tk  the  first  nonhasic  constraint  is  a critical  constraint.  Thus,  (17),  (18),  (19)  can  be 
written  as: 


Max  (r7i  ' )i>i  c . . . + (c^B  c,,t 

s.t. 

/)„(r)„«y„«/»„(f)„ 
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/j  (Oiitl  ^ «1>1  + • ■ ■ + «nyn  « (OnH 

biU)  ^ NB  'y^  b'^u) 
where  A'  are  the  remainintt  nonbasie  rows. 

If  we  choose  to  replace  the  critical  nonbasie  constraint,  which  is  satisfied  as  equality  on  its  upper 
bound  (lower  bound)  with  the  8i  basic  constraint  for  which 


(i)  o,  ^ 0 


...  (c^B  ')i  {dB  '),  {c^B  ')j 


(lii)  — 


« ‘)A 


5-^  0.  /■ 


Then,  the  tableau  obtained  after  performing  the  proper  basis  change  is  also  optimal,  i.e.  the  new  >,'s 
satisfy  the  optimality  criterion  (20). 

The  above  basis  change  wiil  be  performed  only  if  it  will  be  possible  to  modify  the  value  of  t in  the 
new  basis  and  thus  to  improve  the  value  of  the  objective  function.  In  this  case  we  would  not  have  to 
solve  an  (IP)  problem  at  the  next  critical  value  of  t (see  step  2 in  Algorithm  A). 

However,  we  remark  that  it  might  be  impossible  to  construct  a new  optimal  basis  which  will 
include  the  critical  nonbasie  constraint,  and  even  if  possible,  we  might  not  he  able  to  improve  the  value 
of  the  objective  function  in  the  new  basis,  by  modifying  the  value  of  /,  in  which  case  we  will  operate 
according  to  Algorithm  A. 

EXAMPLE  [9]:  Solve  the  (FIP)  problem: 

„ 3vi-  t:,  c4 


s.t.  -Isj».  +.r:i'S2 


X - .■) 


Clearly,  since  x-i  ^ 1 (EI.P2)  is  not  feasible  and  thus  we  need  only  to  solve  lELPl).  A feasible 
solution  to  lElP)  is  jr‘  = (0.  1.0)  for  which  I){x')  >0.  From  1 15)  we  get  = (0.  1/2.  0 ) . /,  = 1 /2  as  a 
feasible  solution  to  (El.Pl).  Problem  (EIPl)  is  of  the  form: 

(EIPl): 

Max  3zi  — z:,  * 4/ 
s.t.  +I:i«2f 


(;enk.kai.  kractionai.  intkr\  ai,  pko(;rammiv. 


63 


/I  0 1^ 
l.el«=  0 I 0 

\o  0 ly 


Then, 


-P  « It 

1 « 

« .S/ 

2.  ) « t 

V/ 

ti 

/A 

/I  0 -1\ 

H '=0  1 0 

\0  0 \J 


c^H  '=  (3, 0,-4). 


V=C  ' 

W)  I 0/ 


Substituting  y=  W;:  in  (EIFl)  results  with 

Max  3vi  — 4>3  + 4/ 
s.t.  - 1 ^ >1  « It 

1/2 « >2  ^1/2 


0 € > :,  S t 

0«  y,  ^yj-  y;, « It 
t S V:  « 5f 


An  optimal  solution  y is  > = (2/,  1/2.  0).  Substituting  y as  a function  of  t in  the  objective  function  and 
the  nonhasic  constraints  results  with 

Max  bt  + 4/ 
s.t.  0«2/+l/2«7f 
f « I /2  « .S/ 

Since  /|  = 1/2.  the  second  nonhasic  constraint  is  critical.  However,  only  the  second  basic  constraint 
can  he  replaced  by  the  critical  constraint  and  for  this  basic  constraint  we  have  />■..  = h'.  Ai'cording  to 
our  method  this  constraint  can  not  he  removed  since  //j  = ^ S>.  Thus  r"'”=  1/2  is  the  optimal  value 

for  t and 
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/I  0 l\  / \ \ I ^ 

;"*"=/<  'v  = jo  1 0 12  (1/2I 

\0  0 I / \ 0 / (I  / 

The  optimal  solution  for  (FlPl  is 

»o|M  — t 

' ^'»pl 
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SOLVING  FIXED  CHARGE  NETWORK  PROBLEMS  WITH  GROUP 

THEORY-BASED  PENALTIES 
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School  of  Industrial  and  Enfcineennft 

Ceorfda  Institute  of  Technolofiy 

ABSTRA<T 


Mdfi>  w(‘ll-kn<iMn  transportation,  rommuniration.  and  larilitirs  l()«alion  prolilein  in 
operations  research  (an  he  formulated  as  fixed  charge  rietw(»rk  problems,  i.e.  as  minimum 
('ost  Hov^  problems  on  a capacitated  network  in  one  commodity  where  some  arcs  have  both 
hved  and  variable  costs.  One  approach  to  sidving  such  problems  is  to  use  group  theoretic 
concept^  from  the  iheorv  of  integer  programming  to  provide  bounds  for  a branch  and- 
bound  pntcedure.  This  paper  presents  such  a group*theor>  based  algorithm  for  exad 
solution  ot  hxed  ('harge  nttwurk  problems  which  exploits  the  specia*  structures  of  network 
problems.  (Nirnputationai  results  are  repttiied  lor  problems  with  as  many  as  100  fixed  charge 


1.  INTRODUCTION 

The  fixed  charge  network  problem  (FCNF)  can  he  formulated  a.« 


min  r[.r  i * cJ.»o  * cj.v 


(2) 


s.t.  hix,+  E<x>  — 0 


(.1) 

(4) 

(n) 


lx,+ly-ls  = {) 

U,  > > 2=  0 
(i,  3 X,  s 0 


(6) 


U|  S ,s  > t) 


7) 


U:  S:  Xj  ^ 1 1 


|8| 


V = 0 mod  U|. 


where  r,.  c,.  s.  U|.  , and  > are  ni-vectors;;  r-..  I-..  u>  and  are  n^j-vectors:  h is  an  m-vector;  Ei  is 
m X n,;  is  m X n <:  c,  > 0;  and  iEi.  1 is  the  node-arc  incidence  matrix  of  a direct  network,  i.e.  a 

matrix  with  columns  which  correspond  to  arcs  of  the  network  and  consist  entirely  of  zeros  except 
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liir  a ^ 1 ill  the  row  t orrespoiidiiig  to  the  origin  noiJr  of  ilu-  arc  ami  a > I in  the  row  ('oiTfspoiiding  to 
tlif  destination  node  of  the  are.  I'lie  prolileni  is  a general  ininiimiin  cost  How  prohlem  in  one  eoinniodily 
willi  the  add“d  features  that  all  variahles  are  hounded,  and  that  a 'uhset  ol  the  How  variables  (the 
,Vij)  have  a fixed  charge  cost  structure.  I'hus  each  .V|,  has  both  a \ariahle  charge  r,  and  a positive 
fixed  charge  /,  assessed  whenever,  .<  > 0.  To  obtain  the  formulation  K(-\  l’,  prorata  amounts  c,,,=/,/i; ,, 

are  calculated,  the  cost  C|,  is  defineil  by  c,,=  c,,  • r,.  and  constraints  on  the  slack  vector  .■>  are  arranged 
^o  that  the  lull  anioMiit  will  be  assessed  when  .xi,  > 0. 

Ill  this  jiaper  the  solution  of  fixed  charge  network  problems  in  the  form  of  |•'(i\l’  will  be  pursued 
by  using  the  group  theoretic  approach  to  integer  programming  developed  bv  Oomory.  .lohnson  and 
others  |2.  3.  4,  ,S.  b,  9,  10,  11|  to  provide  bounds  for  a branch-and-bonnd  approach.  Hesults  in  |15|  lor 
general  fixed  charge  problems  li.e.  proldeiiis  like  KTNI’  where  no  special  structure  off.’i  and  A-  i'  as- 
sumed) are  speciali/.ed  to  the  network  ease.  -Xn  algorithm  using  the  results  is  then  outlined  and  computa- 
tional results  presented. 

2.  NOTATION 

In  order  to  eHVelively  present  observations  about  K(!\l*.  some  notational  conventions  will  be 
reipiired.  For  the  convenience  of  read«'rs,  these  eonventions  an-  siimmari/.ed  below. 

1.  .'^ets  of  rows  from  a matrix  tor  vector)  will  be  denoted  by  eni  losing  the  mtitrix  in  brackets  and 
indicating  the  limiting  row  numbers.  For  example, 

[,U  ]J|  = the  subiinitrix  consisting  of  rows  I through /,  of  1/. 

Vi  hen  only  a single  row  of  a matrix  is  reijuired.  the  convention  will  be  simplified  bv  dropping  the 
redundant  superscript,  and  if  no  conlU'ion  will  result  the  brackets  will  also  be  omilled  leaving,  for 
example, 

.<  I , = tbeyth  row  or  component  of  the  vector  v i 

3.  .-Ml  references  to  optimal  solutions,  bases,  and  tableaux  tor  various  linear  programs  will  be  with 
respect  to  bases  ipI  tile  well-known  bounded  simplex  proceduie.  W ben  it  is  desired  to  speak  of  the  |iart 
of  a solution  vector,  cost  vector,  bound  vi'cior  or  matrix  associated  with  the  basic  variables,  nonbasic 
variables,  etc.,  the  usual  rearrangement  of  rows  and  columns  will  be  assumed,  iind  irlentifying  su(ier- 
scripts  will  be  iittai  hed  to  submatrices.  Specifically . the  supcrscii|it  H will  denote  the  basic  part  of  the 
matrix.  ,\  the  nonbasic  part.  I tin  |iart  with  nonbasic  variables  at  then  upper  bounds,  and  /,  the  part 
with  nonbasil'  variables  at  their  lower  bounds. 

3.  .-\  bar  o-  er  the  name  ol  a problem  will  deno'e  the  continuous  relaxation  of  the  problem,  i.e  the 
same  iirobleni  with  any  congruence  constraints  relaxed.  Klemeiits  of  the  optimal  solution,  optimal 
sini|ilex  tableau,  etc.  for  such  a continuous  relaxation  will  be  similarly  denoted  by  bars  over  the  nani  -s 
of  the  (dements.* 

■ I )iiiiU|;l'  ul  itii-  |ia(ii  r l)ir  u-iial  siiiipiiliralMm  "t  n-li  rmit;  In  an  M)i'iinal  sutntnni  a-  il  il  vm-h-  iinn|in-  e iili.crw'd.  I iicii' 
ina\.  III  i-i.iii'i'.  111-  mam  lia-n  .nluiinn^  wlin  li  ~ati.|i  .<iin|i|i'\  ii|i|iinalil\  cnli-ria  llnwmi  i,  iln-  pw-n  irsnli.  Inilil  Inr  anv  siirli 
'iiliilinn.  and  lln*  nnlv  iimsdili-  c-lTrrI  nt  .I'icm.ilivc  siiluiiiin.  is  in  make  smnr  fit-nallit-s  /rin  In-i  aiist-  iln-  adinso-d  rust.  nl  enro-- 
s|.iindmi;  nmdiasir  varialilcs  an-  /ern. 


' * ■ “ iJiw' 


^^!^f^fwwap»w»ww 
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4.  I'Ik'  futiclion  mu  IH  will  he  used  to  <lfnol<*  ihe  value  ol  an  npliinal  Milutinn  l<>  the  iirohlem  pveri 
as  its  argument. 

3.  RESl  l/rs  FOR  (;ENKRAI.  fixed  CliAR(,E  I’RORI.EMs 

The  analysis  ol  |16)  developed  a nuniher  of  structural  result‘d  lor  general  lixetl  charge  prohlenis 
which  will  he  exploited  in  the  algorithm  of  this  paper.  The  next  lew  sections  hriefU  outline  the  mo^t 
imi)ortant  of  thesi'  results.  Though  the  results  are  staled  in  terms  of  the  not.ilioi:  ol  K(  .\l*.  they  ap()lv 
to  any  hounded  fixed  charge  prohlem. 

3.1.  Th<‘ (Continuous  Reluxalioii 

.At  each  iteration  of  a grouji  theory-hased  hraneh-and-hound  solution  pro<  edure  the  continuous 
relaxation  FfCNI*  of  a K(C\I*  must  he  solved.  In  |I.Aj  it  was  shown  that  all  elements  of  any  optimal 
basic  solution  to  KCCNI*  could  he  constriicled  from  the  sidiition  to  the  ri-duced  netwi.rk  [)rohlem  iHNI’i 


CJ) 

min  c'  1 1 • e] 

I 10) 

s.t.  /,’i  1 1 Fj  1 

Ml  ) 

It,  ' i,  0 

1 12) 

,1.  ^ X.  1. 

If  forms  an  optimal  basis  lor  K\P.  {a''.  > ) is  an  optimal  basis  for  K(C\P.  Tbe  corresponding 

optimal  solution  is  given  by 

V > I - « I 

* j i: 

.V  - 0. 


where  {.f|.  ij}  is  the  optimal  solution  to  KNI’. 


3.2.  IVnalty  Sultproldeiiis 

•An  ecjuivalent  form  ol  any  linear  mixed-integer  program  can  always  be  obtained  by  solving  the 
continuous  relaxation  ol  the  problem  and  rewriting  the  pndileni  in  terms  ol  peiturbatnms  Ikoii  tin 
values  of  the  nonhasic  variables  in  the  optimal  eonlinuous  solution.  The  optimal  simplex  tableau  i- 
Used  to  represent  changes  on  basic  variables  in  terms  of  perturbations  in  the  nonbasics.  It  is  shown 
in  1 1 .)|  that  such  an  ei 
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ll7) 


As,  Ax',  , Ax!j,  Ax!,  ^ 0 


4 As  3=  0 


u,  s As 

£i{  = Ax|,  u'l  i-  Ax', 

{u'.i  — /!,  I ^ Ax!.,  (u!,  — /!,  I s Ax!, 

Ax',  = u!,  — X.' 

As  = s - 0. 

A"  = the  dimension  of  Xi". 

and  c'.  ri.  C|\  £'j  are  taken  from  the  optimal  simplex  tableau  for  KNP.  The  relaxation  of  this  ei|uiva 
lent  form  consistin^t  of  (13).  (14).  and  (hS)  is  the  uroup  problem  of  (lomory  and  Johnson  (denoted  (IP 
(FCNP)). 

(iP(KCNP)  is  generally  difficult  to  solve.  Thus  a number  of  relaxations  were  developetl  in  |15)  to 
produce  jienaltii-s  lor  a branch-und-bound  procedure.  Relaxations  of  (IPlFCNP)  where  only  the  rows 
of  (14)  with  numbers  in  an  index  set  I are  enfor<-ed  are  denoted  (iPlF).  When  a (IPd'l  is  further  con- 
strained to  satisfy  (18).  (I'll,  and  (20),  it  is  referred  to  as  a bounded  (iroup  problem  and  denoted  B(iP(F). 
Finally,  when  a (!P(I  ) is  constrained  to  salisfx  all  rows  / of  (17)  for  ;el,  it  is  referred  to  as  an  edber  ot 
problem  and  denoted  EOPd  I.  The  name  for  the  latter  problem  derives  from  the  fact  that  EOPd  ) is 
GPd  ) with  “=  mod  u i,"  repilaced  by  ”=  y,  or  u,,  — y,"  in  row  ; of  ( 14)  for  each  (t  F. 

Observe  that  all  these  subproblenis  can  b<‘  constructed  directly  from  the  optimal  simplex  tableau 
lor  HNP,  Moreover,  the  bounds  obtained  from  solving  the  subproblems  have  the  'ollowing  (divious 
relationships; 


e |(;P(|  ||  - e|(FC\Pl| 
e lEOPd  l]  ^ e|(;Pd  )| 
e |lU;P(l  l|  3 e((;Pd  i| 
e [(d’d  )]  3 elliPd  'll  I 
elEOPd'il  3e|E()Pd'i|  [ 
1' [B(;P(I  ||  3 e|R(;Pd  l|  ) 


(18) 

(19) 

(20) 


where  Ax{  = x{  — 0 
AxJ’  = u\  — x'l 
AxA  = xi  - U, 


I 'C  I . 
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4.  THE  NETWORK  CASE 

The  algoritlim  to  he  presented  in  this  paper  employs  a hranrh-and-hound  approach  where  the 
above  suhprohlems  are  used  to  provide  penalties,  In  such  an  approach  certain  of  the  confiruence- 
constrainted  variables  y,  are  fixed  at  either  0 or  lUj.  and  the  continuous  linear  program  obtained  by 
relaxing  congruence  constraints  on  the  other  y,  variables  is  solved.  From  the  optimal  simplex  tableau 
lor  this  linear  program  a series  of  penalty  problems  is  constructed  to  obtain  lower  bounds  on  bow 
much  the  value  of  the  continuous  optimal  linear  programming  solution  would  have  to  be  increased 
to  produce  an  optimal  solution  for  the  original  fixed  charge  i)roblem.  These  bounds  or  penalities  are 
then  used  to  reduce  the  set  of  remaining  possibilities  for  optimal  solutions  to  FCNP  and  choose  a new 
branching  variahle,  i.e.  a new  variable  to  fix  so  that  enumeration  can  continue. 


4.1.  Solution  of  the  Continuous  Relaxation 

The  above  discussion  of  properties  <if  general  fixed  charge  problems  highlighted  the  importance 
of  the  reduced  problem  RNP  in  the  various  steps  of  such  a branch-and-bound  procedure.  In  the  network 
case  RNP  is  hy  definition  a minimum  C()st  flow  problem  in  one  commodity.  Thus,  the  various  steps  in 
the  branch-and-bound  j)rocedure  involving  RNP  can  be  simplified  by  exploiting  the  network  structure. 

One  of  the  most  powerful  sets  of  theory  for  minimum  cost  flow  problems  is  tbe  graph  theoretic 
approach  development  i)y  .lohnson  [8|  and  l.angley  |13]  and  <»thers.  In  the  terminology  of  this  approach 
a graph  is  a collection  of  arcs  and  nodes  associated  with  some  network;  a cycle  is  a connected  set  of 
tw(i-ended  arcs  of  the  graph  which  touches  nodes  in  such  a way  that  every  node  is  touched  by  exactly 
two  arcs:  a tree  is  a connected  set  of  two-ended  arcs  which  contains  no  cycles:  and  a forest  is  a set 
of  trees.  \ forest  is  said  to  span  a graph  if  each  node  is  touched  by  exactly  one  tree.  If  a one-ended 
arc  is  added  to  each  tree  so  that  the  number  of  nodes  is  ecjual  to  the  number  of  arcs,  the  one-ended 
arc  is  called  a root,  and  the  tree  is  said  to  l)e  a rooted  tree.  A collection  of  such  rooted  trees  is  a rooted 
forest,  and  a rooted  forest  which  spans  a tietwork  is  a rooted  spanning  forest. 

In  terms  of  these  definitions,  the  fundamental  result  on  which  the  graph  theoretic  approach  to 
network  flow  problems  is  liased  can  be  stated  as  follows; 


1.1.1.  Theorem  (nee  |8|). 

The  arcs  associated  witb  any  basis  of  a network  How  prolilcm  like  RNP  form  a rooted  spanning 
forest  for  tfie  network. 

Define  the  node  of  a rooted  tree  touched  by  the  root  as  the  //o.\e  of  the  tree.  Then  the  importance 
of  Theorem  4. 1. 1 derives  from  the  fact  that  by  systematically  searching  from  tbe  base  of  each  tree  in 
the  spanning  forest  ass(tciated  with  a basis  for  a problem  like  RNP.  it  is  possible  to  reach  all  basic 
arcs  and  all  nodes  without  cycling.  In  particular  define  the  direction  up  in  a tree  as  away  from  the 
base  of  a tree,  and  down  as  toward  the  base,  .'similarly,  nodes  and  arcs  will  be  said  to  be  above  a given 
node  or  arc  in  a tree  if  they  can  be  reached  by  preceeding  up  the  tree  from  the  given  node  or  arc.  Then 
by  maintaining  arc  flows,  dual  multipliers,  and  the  following  labels,  it  is  possilile  to  easily  perform  all 
simplex  operations  necessary  to  solve  RNP.  i."see  for  example  1 14)  for  the  details  of  a simplex  procedure.  I 


a 


i 

4.1.2.  Definition.  I 

I 1 

The  basis  label  of  a node  w in  a network  problem  like  RNP  is  /uin  I.  yuct.  (H/c)|  where  1 
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8iw)  = the  nuiulMT  ol  thf  node  dirrctly  licluw  u in  tin-  liasi;.  Cnrcsl  (0  it  w is  the  base  of  a tree). 

/Lil/(  ) = tlie  nuinlter  of  a no<le  direct’  iliove  u in  the  liasis  forest  lO  if  no  such  node  exists). 

■y(ic)  = the  iimnher  of  a node  c such  that  ft(;c)  = ft(2)  and  yli)  : for  all  z ^ ic  satisfyiof!  fi(n  ) = 
S(z)  (0  if  no  such  node  exists). 
alM  )=  the  nuinh<‘r  of  the  arc  coniieetinn  u and  fi(ic). 

The  components  of  the  basis  label  are  referred  to  as  the  tioun  nude,  up  node,  rifzht  node,  and  down  arc, 
respectively. 

Figure  I provides  one  of  several  sindi  sets  of  basis  labels  for  a sample  basis  forest.  For  examph'. 
the  down  node  label  of  node  4 is  7 In-cause  7 is  the  next  closer  node  to  the  base  of  the  forest,  and  the 
down  arc  label  of  node  4 is  17  because  arc  17  connects  nodes  4 and  7.  Thi-  chain  of  nodes  immediately 
above  nod«-  ,'f  begins  with  node  2.  whicli  is  tlie  up  node  from  .4.  and  proceeds  right  to  node  8. 
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4.2.  (Generating;  (Gonsiraint  Matrices  for  Suli|>robleins 

The  constraint  matricc-  nf  the  \arioUs  subpioblems  detim-d  in  section  .4.2  consist  of  rows  drawn 
from  the  constraints  i|4)  and  1 H ).  (lareful  study  of  the  *-xpressions  for  ll4)  and  (17)  will,  in  turn  show 

that  all  nontrivial  rows  of  thevc  constraints  ti.c.  rows  1.2 /i " ) are  extracted  directly  irom  the 

rows  of  the  optimal  KNI’  simplex  tableau  which  corres|)ond  to  basic  components  of  Thus,  the  es- 
-■ential  problem  in  generating  constraint  matric*-s  for  th<-  |)enalty  sul)|)rol)lems  is  to  generate  the  rows 
of  the  updated  simjdex  tableaux  for  K\l'  w hich  corres(iond  to  basic  comi)onents  of . 

.Suppose  now  that  H\F  has  be  solved  by  a graph-theoretic  simplex  procedure.  Since  the  simplex 
tableau  corrr-sponding  to  the  optim.d  labels  has  never  been  exi)licitly  calculated,  a procedure  for 
generating  nontrivial  rows  of  the  penalty  subproblems  from  the  labels  is  lopiired. 

The  usual  approach  for  generating  u|>dated  simplex  tableaux  fr:  m initial  tableaux  >s  to  premulti|)ly 
the  original  tableaux  bv  a basis  inverse.  In  the  case  of  an  original  tableau  which  is  a node-arc  incidence 
matrix,  the  process  amounts  at  most  to  taking  the  difference  of  two  columns  in  the  basis  inverse  be- 
cause there  is  at  most  one  • I and  one  I in  1 aeh  column  of  tbt  original  tableau. 
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f,  From  the  above  observations  it  follows  that  constraint  matrices  for  the  various  penalty  subproblems 

; can  easily  be  generated  if  an  optimal  basis  inverse  for  RNP  can  be  constructed  from  an  optimal  set 

of  basis  labels.  The  following  theorem  from  the  theory  of  the  graph-theoretic  approach  to  network 
problems  shows  that  this  can  be  easily  accomplished  by  using  the  labels  to  trace  the  nodes  of  the  net- 
r work  above  a particular  arc  in  the  optimal  basis  forest. 

4.2.1.  Thforrm 

The  row  of  the  basis  inverse  corresponding  to  any  basic  ar<‘  of  KNP  will  have  t 1 entries  for  all 
nodes  above  the  arc  in  the  basis  forest  if  the  arc  is  directed  away  from  the  base  ol'  its  tree,  and  — I 
entries  for  all  nodes  above  the  arc  in  the  basis  forest  if  the  arc  is  directed  toward  the  base  of  its  tree. 
■All  nodes  not  above  the  arc  in  the  basis  forest  will  have  0 entries. 

PROOF:  See  113]  p.  ,5, S. 

Before  turning  to  an  example,  one  additional  observation  can  be  made.  Recall  that  ortTy  th<  rows 
of  the  optimal  tableau  for  RNP  corresp<>nding  to  basic  components  of  x,  are  required  to  generate  sub- 
problems. Thus  the  corresponding  rows  <«,'  the  basis  inverse  are  the  only  ones  required,  and  the  follow- 
ing definition  will  lead  to  a further  simplification. 

4.2.2.  Detinition 

A macro-nod*'  of  a basis  forest  for  RNP  is  a single  node  used  to  replace  any  maximal  set  of  ordi- 
nary nodes  in  the  forest  of  RNP  which  are  connected  by  a tree  (<f  basic  arcs  drawn  entirely  from  the 
vector  xj. 

The  effect  of  grouping  nodes  of  a network  into  macro-nodes  is  to  collapse  the  optimal  basis  forest 
fo:  RNP  into  a tree  consisting  entirely  of  arcs  with  fixed  charges  (i.e.  compi>nenls  of  ril.  Figure  2 
illustrates  this  reduction  for  the  example  of  Figure  1. 


Associated  with  this  reduction  in  the  complexity  of  the  basis  forest  for  RNP  is  a simplification 
in  calculation  of  the  basis  inverse.  The  following  theorem  states  the  results. 


s 
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4.2.3.  Theorem 

The  columns  of  a basis  inverse  for  RNP  corresponding  to  any  two  nodes  w and  z which  are  part 
of  the  same  macro-node  will  have  equal  entries  in  all  rows  associated  with  components  of  acf . 

PROOF:  Let  xij  be  any  basic  element  of  xi  and  'F  be  the  set  of  nodes  above  Xij  in  the  basis  forest 
for  RNP.  For  any  two  nodes  w and  z which  are  members  of  the  same  macro-node,  the  unique  path  be- 
tween the  nodes  in  the  basis  forest  for  RNP  consists  entirely  of  arcs  corresponding  to  elements  ofjtj. 
Thus  xij  is  not  a part  of  that  path  and  either 


tce'P 

and 

ze'P 

and 

z4'l' 

In  either  case  it  follows  from  Theorem  4.2.1  that  nodes  m>  and  z will  have  identical  entries  in  the  row 
of  the  basis  inverse  corresponding  t<»  jfij.  Q.E.D. 

The  importance  of  the  above  discussion  lies  in  its  implication  that  a reduced  basis  inverse  for 
RNP,  which  contains  one  row  f<»r  each  component  of  xl^  and  one  column  for  each  macro-node,  is  all 
that  is  required  to  generate  the  nontrivial  elements  of  the  penalty  subproblem  constraints.  Thus  the 
problems  GP(F),  BGP(F)  and  EOP(l')  can  be  e.  4y  constructed  if  the  following  labels  are  obtained 
from  the  optimal  basis  forest  for  RNP. 

4.2.4.  Definition 

For  each  node  w in  the  basis  forest  for  RNP. 

t}(m  ) = the  tiumber  of  the  macro-node  to  which  u belongs. 

For  each  macro-node  z in  the  macro-node  tree  for  RNP. 

All,  zl=  the  element  of  the  reduced  basis  inverse  for  RNP  associated  with  the  /th  component  of 
and  the  macro-node  z. 


4.2.5.  Aliiorilhm 

Let  [8(n  ) , /u(  n ) , y(n  ) , «(n ) ] be  the  labels  of  an  optimal  basis  forest  for  RNP  as  defined  in  Defi- 
nition 4.1.2.  Then  the  labels  Tj(n).  and  A(j,  k)  can  be  obtained  as  follows: 

STEP  0.  Set  the  next  available  macro-node  k=  1 and  Alt,  A ) = 0 for  all  i and  k. 

-STEP  1.  Scan  sequentially  the  nodes  until  a new  tree  base  (i.e.  a node  n with  6(nl=0)  is  found. 
If  none  is  found,  stop;  the  algorithm  is  complete.  Otherwise,  set  the  arc  index  set  .\  = 4>,  the  current 
node  n'  = the  number  of  the  nod«-  which  is  the  new  base.  Tj(n’)  = l,  and  the  current  macro-node 
A ' 1 . and  go  to  Step  2. 

STEP  2.  Proceed  up  by  letting  n = fiin’).  If  ri  = 0 go  to  .Step  .5.  Otherwise,  proceed  to  .Step  3 if 
a(n)  is  a component  of  Xi  and  to  Step  4 if  it  is  a component  of  »■.. 

.STEP  3.  Let  .\  = .\  U {a(n)}  if  a(n)  is  oriented  away  from  the  base  of  the  forest,  and  .\  = .\  U 
(— a(n)}  iftt(n)  is  oriented  toward  the  base  of  the  f<»rest.  .\lso  let/-=A-(-  I.A'  = A,A((.A')=+1  for 
all  i in  ,\  such  that  i > 0,  and  A ( — / . A ' ) = — 1 for  all  i in  \ such  that  / < 0.  Then  go  to  Step  4. 
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STEP  4.  Set  n' = n and  T;(n' ) = A Then  go  to  Step  2. 

STEP  5.  Proceed  right  by  setting  n = y{n').  If  n = 0 go  to  Step  6.  Otherwise  remove  ±a(n') 
from  A if  a(n')  is  a component  of  jti , set  k'  = rf{8{n')),  and  then  go  to  Step  3 if  a(n)  is  a component  of 
Xi , and  to  Step  4 if  it  is  a component  of  JCa- 

STEP  6.  Proceed  down  by  setting  n = 8{n').  If  n = 0,  go  to  Step  1.  Otherwise  remove  ±a(n') 
from  A if  a (n' ) is  a component  of  xi , set  n = n and  k'  = r){n'),  and  go  to  Step  5. 

Table  1 illustrates  the  algorithm  for  the  case  of  Figure  1. 


Table  1.  Steps  in  Algorithm  4.2.5  for  Example  Problem  RNP 


Algorithm 

step 

Variables  assigned  values 

Algorithm 

step 

Variables  assigned  values 

0 

k=\.  all  AO,  *1=0 

2 

n = 0 

1 

A = <t>,  n'  = 1,  T)(l)  = 1.  *'  = 1 

,s 

n = 0 

2 

n = 0 

6 

n = 3.  n'  = 3.  * '=  1 

.5 

n = 0 

.S 

n = 0 

6 

n = 0 

6 

n — 0 

1 

A = <t>,  h'  = 3,7)(3)-  1,  *'  = 1 

1 

A = <1),  n'  = 7.  t/(7)  = 1.*'  = 1 

2 

n = 2 

2 

n=-4 

4 

n'  = 2,  t)(2)  = 1 

3 

\={-17},  A = 3.  *'  = 3.  A(I7.  3)  = - 1 

2 

n = 6 

4 

n'  = 4,  t)|4)  = 3 

3 

A = ( -12}.  f = 2.  *’  = 2,  A(12,  2)  = -l 

2 

n = 0 

4 

n'  = 6,  Tjift)  = 2 

.5 

n = 9,  A = <t>,  *'=  1 

2 

n = 0 

3 

+ 

II 

■< 

II 

+ 

II 

5 

n = 5,  A = <t>,  *'  = 1 

4 

n'  -9,  7)19)  = 4 

4 

n = ,S , T)  ( 5 ) = 1 

2 

n = 0 

2 

a = 0 

S 

n = 0 

5 

n = 0 

6 

n = 7,  \ = <t>,  fi'  = 7.  *'  = 1 

ft 

n'  = 2,  *'=  1 

s 

n = 0 

S 

n = 8,  *:'  = 1 

6 

n = 0 

4 

n'  =8.  17(8)  = 1 

1 

Stop 

4.3.  Right-hand-sides  and  Objective  Function 

Once  penalty  problem  constraints  are  generated  according  to  the  above  principles,  the  only  re- 
maining elements  of  the  problems  to  be  produced  are  the  right-hand-sides  and  the  objective  function. 
Review  of  (13),  (14),  and  (17)  will  demonstrate  that,  like  the  constraint  matrix,  these  elements  of  the 
subproblem  are  derived  directly  from  the  optimal  basic  solution  to  RNP.  The  right-hand-sides  are 
obtained  from  the  optimal  FCNP  value  of  y which  is  in  turn  equal  to  the  optimal  RNP  flow  on  jti. 
Similarly,  if  the  optimal  RNP  simplex  multiplier  for  node  n is  7t(m  ) and  arc  Xij  runs  from  node  Ai  to 
node  k-i.  then  the  objective  function  coefficients  are  calculated  by  Cij  = Cij  + ir(k\ ) —n(ki). 

4.4.  Solving  Penalty  Subproblems 

The  algorithm  and  computational  results  which  follow  are  based  on  the  solution  of  one-  and 
two-row  versions  of  the  penalty  subproblems  ('.Pd'),  B(iP(D,  and  EOP(I').  For  the  one-row  cases 
of  these  problems,  solution  is  elementary,  it  is  easy  to  show  (see  11,31)  that  r’[(iP(i)]  = n[E()P(i)]. 


76 


K.  1..  KAKDtN  AM)  V.  K.  UMiKK 


Thus  a solution  to  either  of  these  problems  can  he  obtained  by  solving  two  linear  knapsack  problems. 
One  corresponds  to  equating  row  i of  (14)  to  y;  (i.e.  moving  >/  “down"  to  0),  and  (he  second  corresponds 
to  equating  the  row  to  («,  — >'/)  (i.e.  moving  Vi  “up"  to  «,).  Th^  well-known  list  search  procedure  for 
solving  such  knapsack  problems  re“duc«“s  in  the  network  case  to  finding  the  variable  which  has  the  smal- 
lest objective  function  coefficient  and  a + I or  — I in  the  constraint  respectively. 

Only  a few  modifications  are  reipiired  in  the  hounded  case  of  B(iP(i).  A solution  to  B(iP(i)  will 
continue  to  equal  the  solution  to  one  of  two  linear  knapsack  problems  like  those  in  F,OP(j).  However, 
upper  hounds  on  the  perturbation  variables  are  ob.served,  so  that  more  than  one  such  variable  may  be 
positive  in  the  knapsack  problem  solutions. 

Two-row  problems  FOP(/.  /)  arc  solved  analogously.  In  this  case  four,  two-row  linear  programs 
corresponding  to  the  right-hand-sides 


are  solved.  The  total  unimodularity  of  the  constraint  matrix  for  (14)  can  be  exploited  to  extend  the  list 
search  solution  procedure  outlined  above  to  such  two-row  linear  programs.  Details  are  given  in  [14]. 

5.  STATEMENT  OF  THE  ALGORITHM 

The  computational  analysis  presented  in  the  next  section  compares  three  different  approaches  to 
using  penalty  problems  in  a branch-and-bound  procedure  for  FfbNP.  Letting 

fi  (any  minimization  nroblem)  = the  best  currently  available  lower  bound  on  the  value  of  an  optimal 
solution  to  the  |iroblem. 
c (any  unbounded  problem)=  — ^ 
c lany  infeasible  problem)=+  and 
c (the  best  known  solution  for  FCNPl=i'*. 

the  algorithm  used  in  obtaining  the  computational  results  is  as  follows: 

■STEP  0.  Place  the  whole  problem  Ff.’NP  in  the  candidate  list  (i.e.  in  the  set  of  restricted  versions 
of  FCNP  which  might  still  yield  an  o|itinial  sidution  to  the  full  problem).  .Set  li(FCNP)  = — ^ and  V*  = 
■c  and  proceed  to  .Step  1. 

STEP  1.  Choose  as  the  current  candidate.  FCNP,-.  the  element  of  the  candidate  list  satisfying 
fii  KCNPr)  ^ min  {/i(  FCNP,.-) : FCNPr'  in  candidate  list} . 


and  proceed  to  .Step  2. 

.STEP  2.  .Solve  the  continuous  relaxation  of  h'C\Pr.  i e.  FCNP,-.  by  solving  HNP,..  If  i(F(jNP,  ) 
^ i'*.  proceed  to  .Step  1 1 because  no  completion  of  FCNPr  (i.e.  no  setting  of  the  y,  not  assigned  values 
in  FCNPr)  can  produce  a solution  to  F(AP  with  value  less  than  that  of  a known  sidution.  If  ^(FCNPrX 
c*.  proceed  to  .Step  ,f. 

.STEP  d.  (ireate  a feasible  solution  for  F('NP  by  rounding  “u|i"  the  optimal  solution  for  F('.NP,.. 
i.e.  by  setting 
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where  i|  ami  x-^  are  lire  opliinal  value^^  <i(  »,  and  ».■  in  the  dilution  «»l  KdM’, . II  the  value  ofthi^  rounded 
solution  is  less  than  e*.  proceed  to  Step  4.  Otherwise  to  (io  Step  5. 

STKI*  4.  A new  incumhem  solution  has  heen  loiind.  i.e.  the  rounded  solution  to  K(  ,'\P,  (rrovides 
a leasihle  solution  to  FCNF  wit!;  value  less  than  any  solution  (ound  so  |ar.  Save  this  ineumhent  as  a 
possible  optimal  solution,  and  eliminate  Irom  the  <-andidale  list  anv  |>rol)lems  with  ji  value  greater 
than  or  erjual  to  the  value  ol  the  new  ineumhent.  II  tiu-  new  r*-  — stop:  F(AP  is  unhounded. 
Otherwise,  proceed  to  Step  ,T. 

.S'l'KI’  .S.  If  no  ;:roup  hased  penalty  |»rohleins  are  to  he  useil.  choose  a hranchinti  variable  v, 
randomly,  i.e.  randomly  choose  a new  v to  ti\  in  F(.\IV.  Then  proceed  to  .Step  10. 

II  penalty  prohletiis  arc  to  lie  Used,  execute  Algorithm  4.2.5  to  idcntily  the  macro-node  assi{inments 
t;,-I  u I . and  the  reduced  basis  itiversc  entries  A,  ( ;.  /,  ) Irom  the  optimal  basis  lorest  lor  H\P,  I hen  no 
to  Step  6. 

.S'l'KI’  0.  (ioti'truct  and  solve  a one-row  n>*>up  hased  penalty  problem  lor  each  row  / in  (.'<-0). 
If  the  value  of  an  optimal  solution  to  any  of  these  one-row  problems  is  nrc-ater  than  or  ecjual  to  c*.  n"  <" 
.''tep  1 1 and  fathom.  Otlu'rw  is<‘.  l<>  Sl«-p  7. 

S'PKP  7.  (isinn  lli*‘  "down"  and  "up"  [»enalties  obtaiiied  in  the  solution  o|  the  one  row  problems, 
i.e.  the  solutions  to  the  knap'ack  problems  correspomlinn  to  mov inn  > . "down"  to  II  or  "up"t';  n , ,.<lt'line 


the  maximum  of  the  values  of  the  "up"  an<l  the  "down"  ease  in  the  I'th  (u.  'dein  ol 
.Ste(i  6 is  aiiionn  the  t nreaU-st  values  it  is  a pr.  delined  parameter  satisfvinn  f > h. 


riien  n"  to  .'step  8. 

.STKI’  8,  For  each  i « A . select  another  row  . and  construct  and  sol\  e K(  )l’,  I / . /,  I.  II  the  value  of 
an  optimal  solution  to  any  o|  these  penaltv  problems  is  ^realei  ih.in  or  eipial  to  c*.  n"  I"  -Step  II  and 
fathom.  Otherwise  proceed  to  .Step 

SI'KI  ’ y.  ( ihoipsc  the  brani  limn  V ai iable  \ , so  that  i is  the /t  A which  maximi/es 
max  j c[F.()l',  I (' .y,  I : v,=  0 1 . I'l  K( )!’,  l » . y, ) : \ , ~ u,,  ] |. 


Then  n"  to  .'step  10. 

.S'l'KI’  10.  I’l  dace  FCNI’,  m the  candidate  list  by  two  moio  resiricteil  problems.  One  is  delined 
by  F(  M’l  with  ilie  iidditional  coiislrainl  that  the  branchinn  variable  i , 0.  and  the  other  problem  is 

identical  except  that  v,  is  restricted  to  eipial  a,,  li  values  lor  these  two  new  l andidalcs  are  as  obtained 
from  the  penalty  problems  ol  .Steps  6 and  8,  Next  proceed  to  .''tep  I to  select  a new  fviNI’,-. 
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S'l'KI’  11.  h'lithom  K(!\l’,..  i.c.  climinali'  KlNl’,  Irom  llic  I'atididulc  list  lifcaiisr  im  I'dinplftiun 
111'  it  can  produce  a lcaf.ililc  sidution  lo  F(^NF*  with  value  lc*.s  than  c*.  li  the  candidate  list  is  nov\  enipsy. 
stop;  if  an  incumbent  solution  exists,  it  is  an  optimal  solution  lor  F('!\l’,  and  otheis.ise  FFNF  is  in- 
(easihle.  If  the  candidate  list  is  not  empty,  proceed  t<i  ."step  1 to  select  a new  FCNPr. 

6.  COMPLTATIONAF  ANAI.V.SIS 

In  order  to  learn  more  about  the  effectiveness  of  the  al|!orithm  of  section  .S.  a numher  of  rundondy- 
generated  problems  were  solved  on  (leornia  lech's  I nivac  1108.  \nswfrs  to  two  j:eneral  ((uestiotis 
were  of  interest. 

1.  ould  the  procedure  solve  problems  as  large  or  larger  than  those  previously  reported  in  the 
literature'.'' 

2.  Is  the  effectiveness  of  the  procedure  significantly  changed  bv  the  Use  of  more  sophisticated 
penalty  achemes'.'' 


6. 1 . Deseripliun  of  Experimeiils 

The  approach  selected  to  accomplish  an  empirical  analysis  of  these  questions  was  a c lassjcal 
lai'torial  experimental  design.  Different  solution  approaches  were  applied  to  randondy-generated  test 
problems  possessing  all  combinations  of  the  properties  previous  researchers  have  indicated  riiosi 
affected  computational  efficiency  of  algorithms  for  fixed  charge  problems. 

In  particular,  a version  of  the  algorithm  of  section  .S  was  used  to  generate  and  solve  fixed  charge 
network  problems  in  manners  specified  by  the  following  factors: 

1.  Type  of  problem.  — W hether  the  jinddem  is  a general  FCNF  ((iNF)  or  a fixed  charge  transporta- 
tion pridilein  ( FCTP).  •.'see  for  example  111)  for  the  formulation  of  this  special  easel. 

2.  Size  of  X|.  — The  number  of  arcs  in  the  prohlem  with  fixed  charges  (code  0~  20.  code  1 = 50. 
code  2 = 75.  code  .5  — 100 1, 

Relative  size  oj  fixed  costs.  — ^ bether  the  fixed  costs  in  a problem  are  small  or  large  relative  to 
variable  costs  (code  1 = small,  i.c.  fixed  charges  made  up  less  than  5 percent  of  the  value  of  an  optimal 
solution:  code  2=  large,  i.e.  fixed  charges  make  up  15-.'f0  percent  of  the  value  of  an  optimal  solution  I. 

4.  Solution  method.  — \ he  combination  of  group-related  penalty  techniques  used  in  solution  ol  the 
problem  (code  ()  = use  no  group-related  techniques:  code  l=i|sc  only  (be  KOI’dI:  code  2 = usc  the 
lIGFd'l  and  EOF(i.  / ) chosen  by  the  criteria  of  [1.5)). 

rile  generation  |iro<  cdurc  (detailed  in  [ 1 ll  I is  an  extension  of  the  a;  proach  of  Klingman.  Napier  and 
Istut/.  [12]  which  creates  feasible  network  problems  of  given  characteristics.  Fixed  charges  on  arcs 
are  correlated  with  upper  bounds. 

It  was  initially  planncil  to  test  all  combinations  of  the  above  factors  at  the  indicated  level  codes. 
However,  preliminarv  (esting  revealed  that  structures  of  (AP's  and  FGl’P's  were  so  different  thal 
results  for  different  solution  procedures  could  not  he  compan-d  across  problem  types.  In  addition, 
early  results  showed  that  problems  with  the  dimension  of  vi  greater  than  .50  could  not  be  solved  within 
reasonable  time  limits  without  some  pimalty  techniques  being  used. 

Thus  two  replications  of  four  separate  factorial  experiments  were  actually  pcrformeil.  The  two 
principle  experiments  focused  separately  on  the  (Al‘  and  FCTP  cases.  Each  case  was  tested  in  all 
combinations  of  large  1 1 sizes  (codes  1.2.  and  ,'f ),  relative  fixed  costs,  and  group-related  solution  methods. 
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In  addilion,  two  special  experiments  were  run  tu  analy/.e  the  impact  <»n  smaller  (i.N'P's  and  FCTF's  of 
eliminatintt  all  groui»-related  penalty  schemes.  These  special  experiments  tested  (iNP's  and  KCTP's 
with  20  fixed  charge  arcs  (code  0).  Results  lor  each  cell  in  the  four  experiments  are  shown  in  Table  2. 

Tahi.E  2.  Results  of  Experiments 
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6.2.  Analysis  of  Experimental  Results. 

I liming  first  to  the  general  effectiveness  of  the  pnacilure,  inspection  of  the  results  in  Table  2 
suggest  that  relatively  large  fixed  charge  network  pnddenis  can  be  solved  in  several  minutes  by  cither 
of  the  group-related  penalty  methods  tested.  Averages  for  each  problem  type.  <i  size  and  fixed  charge 
pattern  reported  in  Table  2 are  within  such  reasonable  computational  boundaries,  yet  the  problems 
with  100  fixed  charge  arcs  are  as  large  or  larger  than  any  FfiNP's  previously  reported  solved  efficiently. 
In  order  to  mor<‘  precisely  address  tiie  second  issue  of  the  difference  between  techniques,  as  well 
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as  to  d*-l<Tniiiu-  iht-  «*Hfcl  of  vurimix  lat'lor*'  mi  lh«-  rxpiTimcnlal  r»--ull'".  'laii-lical  anaK-i'  i>(  variaiicc 
v>a-  ap|*li«'(l  to  the  result'.  ’Fli*-  'lati><lical  a*<>-uiiipti<>ii-.  iimli-rl\ini:  llic  analv-i'-  ui  xarianrc  rould  imt 
Ilf  vi-rificd  in  th<-  ridativrly  un^lru(•Ulr«■d  domain  o(  randoiidx  )>(-iiiTat(-ii  optimi/alioii  pr..  Icni'.  Hov% 
t'WT.  'incr  all  the  pridiicni  laclor>  oilier  researeher'  have  iiidiraled  liad  -i^nitieanl  efTecl->  on  coinpula 
iimial  result'  were  Ineluded  in  the  experimeni'  and  the  AN<)\  \ pmeedure  i'  well  knevx  ; to  he  r(p|iU't. 
ihe  (irocedure  v\as  emi'idered  adeipiale  lor  indicating  the  importance  o|  \arioU'  eflect', 

rile  response  xariahle  selected  lor  analxsis  i»  the  nunih«‘r  ot  candniate  prohleni'  explicilh  in\es  i 
(lateil  in  soKme  a K.NlV  I his  \ariahle  was  chosen  tie<  aii'c  it  appears  tn  one  the  most  ai  i urate  nieas 
lire  ol  the  true  impact  ol  dilTerent  >:rouj)  relat<'il  penallx  (iroi  eilure'.  >ohition  time'  ate  also  ver\ 
;m|iortant.  hut  the  effect  ol  the  various  |ienalt\  |»ro<  ediires  on  solution  limes  i-  cloudiol  h\  the  ()to|:ram 
minj;  elhciencv  ol  routines  to  execute  the  penallv  prm  eilures. 

Kesiills  ol  the  anaK'is  ol  \aiiance  lor  this  respoiisr-  xariahle  aie  pxeii  in  Tahles  A throiiph  h and 
ilhi'lraled  in  hipcres  .1  and  4.  Ihe  sitiiiihcance  ol  various  lactor-  implied  hv  the  result'  i'  discussed  m 
ihe  next  several  suhseclimis. 
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<1.2.1.  Si/r  of  t,  KflTrrt* 

>iiiri'  llic  |iii"iMi-  iiiiiiilici  III  < itiiilnl.ili  |iii>lilriM'  iiicn  asrs  i xi'iinmlialK  «itli  l!ir  'i/r  nl  ll'c 
1 I M l im.  ll  I iiiilil  111'  rx|ii'i  li'il  lli.il  llii'  niiiiiiii'i  III  raiiiliil.ili'  pculilcms  acliialK  snlvnl  vmiuIiI  also  |n' 
j:tiMlK  al)i'i  li'il  li\  llir  'I/I-  111  X i.  \naK'is  n|  varianri'  n'^iills  Im  (.NT's  omu'ralK  i iiiiliTin  llii>  l■\|ll■^la 
liiiii  a-  ilii  llii-  tirapli'  in  M^iiii'  V ll  i-  iiili'ir'linp.  llial  tin-  'ami-  statisiii  al  sii^iiilicancr  is  iml  hIisitm  iI 
III  till'  1 Is  nil ' I'll  Ml  I ’ I ll  iwi'M'i , till-  riiiM's  III  1- 1 >111 1 1'  1 (iTtainl\  sUMfirsi  snmi-  si/m  n|  i , I'Hi-i'i. 
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K 1.  KAKOIN  AM)  V E.  IN(;KR 


MEAN  NUMBER  CANDIDATE 
PROBLEMS  SOLVED 

1000  • n 


750  • 


500- 


NO  PENALTIES 


250 


EOP(<)  ONLY 


N 


A 


■CPI  it  a CRITERIA  CHOSEN 
EOP(i.j) 


.SIZE 
OF  Xi 


25  50  75  100  *1 

h K.LRE  4.  Mean  numln  r ul  carulidatr  pri>l>l*-m-  miKciI  tor  Iranspuralion  prohlrins  liy  nl  > and  ••i)luliiiti  inrlhmi. 


6.2.2.  Rflativf  Fixrd  Coat  EfTrrta 

.Most  previously  reported  research  on  hxed  iharge  problems  has  indicated  that  computational 
efficiency  is  highly  efTected  by  the  relative  size  of  the  fixed  and  variable  costs.  If  fixed  costs  are  small. 
H FCNFl  provides  a good  estimate  of  eiFf^NP).  and  only  a lew  candidates  need  to  be  explicitly  explored, 
fallen  fixed  costs  are  high,  however,  numerous  possibilities  for  v must  be  investigated. 

Experimental  results  for  FfiTP's  strongly  conhm  this  previous  experience.  The  cost  effect  is  very 
significant  in  both  Table  4 and  Table  6.  However,  results  for  (i.NP's  show  Hie  relation  between  fixed 
and  variable  costs  is  relatively  insignihcant.  A possible  explanation  of  this  phenomenon  is  the  higher 
fixed  costs  in  GNP's  tend  only  to  fon-e  all  flows  along  arcs  without  hxed  charges.  Thus,  the  value  of  a 
i'(F(iNP)  as  a bound  on  e(FC  sPl  is  not  diminished  as  hxed  charges  increase. 


6.2.3.  Solution  Method  EfTerlft 

The  experimental  factor  of  greatest  interest  to  this  research  is  the  effect  of  changing  the  solution 
procedure  used.  Any  techniijues  shown  to  be  signihcantly  superior  would  provide  suitable  focuses  for 
future  re*  earch  and  applications. 

.All  results  show  at  least  mildly  signihcant  solution  method  effects,  with  the  effects  accentuated  at 
high  relative  costs  in  FfiTP's.  The  most  outstanding  of  these  effects  is  the  difference  between  the 
no-group  analysis  and  one-row  analysis  methods.  Even  lor  the  relatively  small  case  of  20  hxed  charge 
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arc--,  rf-ull'  in  ralilf-  3 ami  I imlicalr  ant  iinpriivcmi-Mt-  ar»-  iilitaim'd  li\  umiih  at  lt‘a>l  -iimc 

tiniup  rrlalfd  |)rnallit''.  Mnrcnvt  r.  ifvi*‘v\  nl  I aide  1?  will  'Imvv  llial  tlif  fiain  i-  |U>l  a-  ureal  il  Mdiitinn 
time  m ( cm-idered  in-tead  id  llie  numlier  id  eamlidate'. 

rile  diHerem  e lieUseeii  iiiie-inw  ami  IVMimvt  lei  liim|iie»  ate  mil  a-  clear  Innii  e\|ierimeiilal 
re-nlt-.  But  1 1 ( A I and  M Tl’  -Ihhm'iI  -nine  -i^niiln  .ml  eHecI-  id  varialmn  in  I lie-e  -i  dm  mil  met  In  id- 
I I ill  lie  .)  and  III  ami  h i”ine-  .1  ,imi  » i i.ntn  m the  eflei  I ”ra|iliii  alU . I Ihvm-m  i . I aide  J -Imw  - ca-e-  v\  her  e 
n-e  id  the  t\Mi  rnv\  aiiaU-l-  im  rea-ed  'idiitmii  lime 

7.  CO.NCl.l  SION 

rile  aliiiM-  re-iill-  .III-  ini  limm.iiA  hut  a|i|n  ai  In  dl•nlnM'lr.lle  that  ;:riin|i  thenr\  h,i-ed  in  ii.dlN 
.l|i|iln,ir|lc-  I ,ni  he  I|lllle  etliil  | \ el  \ ,i|i|died  In  h\ed  i Inline  llelWnik  |i|nhlem-.  I he  n|  i-en  .11  mil-  III 
-ei  Imil  t ileMlnll-l  1 .11  e the  -l”mtli  .nil  -llll|dll|i  .lllnll-  le.dl/ed  III  |ieii,dl\  ,i|i|i|n.ti  he-  when  the  -|ieei,il 
-tim  tine  n|  nelwnik  |i|nhlem-  i-  e\{dniied  I .nm|iiilatmn.d  e\|ienem  e m -eetmn  . ennliim-  the  value 
id  .Il  le.l-l  -nine  ll-e  id  |ieli.lll  le-.  Il  wmild  leilaniK  .IIiimmi  th.ll  t:inn|i  li.l-ed  |>en.lll\  ,l|i|itn.ielie-  are 
wnrlliv  111  -i^nnlii  .nil  liirthei  m\e-li;.,itmn 


i{KKKKr;N<;Ks 

I I ) Hal  ill -k  I . M.  I . . "I  l\ed  ( 11-1  I I .III -I  ml  .It  mil  I'nddem-.  N.l  v . He-  In;;,  (_tll.ll  I, . H.  H .)  I I I'dl  I I 

I J 1 ( .niimrv  . H.  r...  "(til  the  Hel.lllnll  Helw  fell  llllejrel  .imi  \nii  lnle;:el  >nhllmil-  In  I me. II  l’ln;;ram-. 
I’rni  eedlllj;-  111  ihe  N.llmil.il  Xeadems  111  ''l  ienee-,  li.ilill  I’li.i  il'tliil 

1 .1  I (.iinmrv.  H.  F.  . ■I'.lie-  id  .in  Inlei^el  I’nKliedrnn.  I*lni  eedni;:-  n|  ihe  N.itmil.ll  \e.ideni\  n| 
.''I  lenee-.  i T.  I (i  I K i I 't(i7 1. 

I 1]  (iniilniv.  H,  h,  , ■■''nine  I ’i  d s I lei  1 1 .1  Hid. lied  In  ( nin  Imi.ltni  i.d  I ’l  i dile  III  - I llle.ll  \l;;elir.l  .mil  ll- 
\ |i|dieal mil- . . kil  iH/fi'ti 

( .')  I (.niiiniv.  H.  K.  .mil  r..  I . ,|nhii-nM.  ■.''nme  ( nntiimnii-  riimimii'  Hi  I. Ill’ll  In  I iiinei  I’nKliedia. 
\l. illiem.iln  .il  I ’i ni;i .inimim:,  (.  LM  K.'i  (I'iTJi. 

I (i  I ( iiimnrv . H,  r,.  .mil  h..  I . |nhn-nii,  ■.''nnie  < nntmimii’.  riimlmn-  Hel.iled  In  ( nriier  l‘nl\hedra 
II.  M.ilheiii.ilii  .d  I’rn^i.mimnm.  i.  k”>‘t  .IH't  (lV7l!l 

|7|  (ii.lN.  I’..  "Mim'iI  lnle;;er  ! ’rna|  aiiimiii;;  Mtmnihm-  Ini  ,''ile  >elei  Imn  .mil  (ilhei  ri\ei|(  hari;e 
I’rnldem-  ll.iMii;:  ( .i|i.ieilv  • iiii-li.nnt-.  I ei  him  il  l{e(inrl  Nn.  1 0| . I )e|i.n I nieiil  nl  ( tpei almn- 
He-e.iri  II  .mil  ''l.iti-lii  -.  .''I.nilnid  I iiim  i-iIv.  I‘H)7. 

|H]  ,|nhii-iiii,  1’.  I ..  I'in;:i.imnini;:  in  Nelwnik-  .md  (ii.iiih-.  ()H(.  He|inil  (i.’i  I.  1 ni\ei-il\  n| 
( .diinrni.i  Herkelev . I'tfi.V 

I 't  i |iihn-iiii.  K.  I...  '■(  M lie  ( ,rnii|i-.  (.iillnm  I’l.me-.  and  >lmrle-l  I'.ilh-.  |ire-enled  .il  ihe  \l.ilh 
em.ilii  al  I ’i 1 1;.’! .innnni"  .''emin.n.  M.ilheni.itie-  He-eareh  ( eiilei.  I nivei-il\  n|  \\  i-enii-in 
M.ldi-nll.  I't7.^. 

I Hl|  .|nhn-iin.  h!.  I . .mil  K.  .''idelheia;.  ^I nei|n.dil ie-  m Hram  h and  Hnimd  l’rn;:r.mninn;;.  IHM  l^e-e.neh 
Heiinit  H(  MfVK  l‘t71. 

Ill  I Kennin“tnii.  I.  I . /n/uje  Ti  (iiisimi  hitinn  /'in/i/em  1 (,ini//i  I liioi  rl  1 1 d/i/n  nm /i , di- 

-erl.ilmn  in  the  .''ehnnl  nl  Imln-lri.il  .md  ''\-leni-  Kn;^meerni;i.  ( .enrjna  In-lilnie  nl  I eehmdni;\ . 


84 


li  I lUKDIN  \M»  \ K I NCKU 


1I2|  Klin;:inan.  I).,  \.  Napier,  and  .1.  Slut/.  ‘'NKT(.K\:  i’l  siram  lor  ( ieneraliii”  l,ar)ie  Si  ale  (ia 

paeitated  A^sifiiiineiil,  rraii>porlalion.  and  Miniiniim  (lost  Klow  I’roldem^,"  Mana^ienienl 
Science  JO.  Hit  -H2I  iMt74l. 

I Id  I l.an^ley.  1{.  Vt.,  (.oiitinuou.s  tint!  Iiitrf’rr  ^rcnrralizi’il  f"  low  I'rohli’ms,  dissertation  in  the  .School 
(d  lixhistrial  and  Systems  Knuineeriiif:.  <i»-orpa  Institute  of  Teelmolofiy.  |y7.'t. 

I I t|  Kardm.  H.  I...  (Iroup  Thooretir  and  Related  Afipnmehe'i  to  I’iied  ('.harfie  I’nddems,  dissertation 
in  tile  School  ol  Industrial  and  >>ystems  Kiifiineeriiifi.  (leorpa  Institute  of 'rechnolo;;v.  |'t7.H. 

lir>|  Hardin.  H.  I..  and  \ . K.  I n^er.  "Some  ( iompiitalionalK  Kelevant  ( iroup  Theoretie  Structure^ 
ol  Kixeil  (diarce  l‘roldems.'‘  to  appear  in  Mathematical  I’rocrammiiit;. 


AU.OCATION  OF  RESOURCES  TO  OFFENSIVE 
STRATE(;iC  WEAPON  SYSTEMS* 


I)  S|n  i»  + aii,J  liihn  U Wui^alr 
\iinil  U tutfutfis  ( .t'ntff 

If  hitt'ihik  l.ttftnratnr  \ 

Siltft  Spring:.  Mat  \lun,i 


AliS  I R \4  T 

III  till'  a \ fi  V \<‘t«atili‘  ^amr  iii<M|«-)  iir\rlnpiMl  ioi  ii»r  111  I III-  In  11^  planning 

■ it  «iiM  »lia(«-^i<  i<iM  r I ill''  lii^liK  a)t^r(*>ial«-  tnn«t«‘|  nptunai  Inrrt-  ini\r*>  tni 

llir  lria<l  I land  and  ''i  .i  lia'x  d mi^-ilt*  ai:d  lM•lnlM■|'>i  undiM  a \arirt\  id  i nii*wtiainl'^ 

I In-  ninilrl  dr'>riilM-d  In-tr  a mMsaliililv  nM>d**l.  . it  i*^  -Imwii  Imvi  tlir  iimdi-i  ran 

• till  hr  il-*r<l  a-  a im-a'Uri*  id  ovrialf  ■N\'*!rlll  rllrrlixrin-'--.  < .nll'*tiaillt-  ini[>i»Hrd  nil  llir 
pi'ildriii  iiirludr  hnlli  > M I and  hiidt^rt  liinitati<Mi«. 

I.  I\TR<UK CHON 

The  tfclinical  ri'Mf's  iicfilcd  Inr  tln'  '<'l<-ciii>n  <>l  '.iralcjiic  |)i>>.iiiri"  is  ( iniilm  Ird  al  \ariiiU' 
lr\(ds  III  Mi|i|iisli('alinn  and  ('i>m|ili<'aiioii  Tlir  iin»t  d<>tailcd  and  lar):)‘st  sitnuialiotis  arc  r-ix-cially 

iiselul  l(ii  llif  lariictiii;;  n|  recnlr>  Nchirlf-  and  llic  |M»iii<inin^  ot  our  innhilc  lnr(  es.  \lan\  cd  lln*  |>ara- 

nu'lcrs  in  a \tT>  lari:t‘  s<  ale  siinulalinn  arc  (xHirlv  l>n<>wn  lot  today's  (‘nvironmonl  and  imisl  In*  I'xlrap- 
idalcd  ito  ali'tirdilx  i l<n  ii'o  in  a -i  onano  |iioi<'riod  .')  or  1(1  vrar^  into  the  (uluro. 

Sniallft  »<  al>'  'imidalioii'  ii'inj:  aji^tcfialo  inodtd*  at'-  ii'«dnl  lor  Ir'tinf:  |(arlii  iilar  projioscd  tone 
sirncinrrs  '!'lic«c  ino<lid'  rf((nin-  llif  |Mo|r(  tioii  o|  Icwrt  paramolrrs  and  arr  lifnrrally  niorr  Indicv aide. 
(ii'tifialU.  llo'\  ate  di  |icndcnl  on  |i<-nolr<ilion  lailir-  and  |io»tiilalfd  ad\er'ar\  lorte  postures  and 
lactif'.  I Ilf  inana;;i'i  i-  pndiald\  iinawaie  o|  ail  tlir  as-nniption-  that  v\rrr  inailr  in  dr\(do[)in”  the 
niodid. 

\n  altrinaliM'  .ippioai  it  to  Ion;:  ian;:r  planning:  i'  the  ii-r  ol  ;:anir  llirory.  I liis  approarli  olitains 
an  ■'opliinar  lone  po'lnn-  at  llic  i xprii'f  o|  aihiitional  .i;;;:rr nation.  Vn  ad\anta;:r  to  lliis  approach  is 
I ha'  the  It 'll  k now  •.  til  o|  i he  a"  n nipt  too-.,  lew  i-  \ < r.  it  i'  -iih)rrt  to  I he  criticism  t hat  not  rnoui:li  details 
are  ii-cd.  rin'  re-iill-  o|  ihi-  l\pe  o|  model  could  he  used  as  in|inl  lor  a simulation  model,  hnt  the 
priniai\  pmtioxc  i-  to  'pncklv  proude  ihc  in.iiiaoei  with  hoth  a ipialitaliNc  and  ipiantitative  niidiT 
'tandin;;  o|  the  clh-i  !-  o|  improvin;:  l•\i'linc  -V'tciii'.  mtrodnein;:  new  -ystems.  .'sM.!’  and  hiidpetary 
re>tiiclion".  imeont  1 ollahle  iiicre  i'e-  in  opcratiii;:  co-iv,  etc.  In  the  ni-\t  -ection  we  de\elop  alon;; 
hi'toncal  hnc'  ,i  came  iheoielic  model  ~mtahlc  lor  the-e  piirpo^ev.  The  model  has  heen  exercised  and 
rc'iill'  aic  prc'cnlcd  m the  cla--ilicil  literature. 

In  'Cl  lioii  III  we  hiiclK  mdicalc  the  mclhoil  ii-ed  to  •.olve  lor  the  optimal  allocation, 

V\"l  k ll.l-  h*  rn  •.il|i|>t>Mrt|  ii\  I ln-  (Mil.  t <il  I In  < llK  | ft  \,|\  .ll  * Ipr  I .ll  HH1'.  < NO  )T  f»(t  I,  Ulhiri  l.l-k  \ UmhfT  \(  )l 

\ h l.'it  \ \u\  pi.init'ti;:  iijr.is  iinli'  .itnj  111  thi'  pjpi-f  .iM  tin-  .inlhm-'  .iini  <1«*  m»l  irpi<  -srii]  \ p«iln  \ m {imrriiiirrw 
‘ I'm  -t  III  illiliil  ift>  < II*  III!  . . i ? I rt  'tiiii;:  I’lK'  . I .ill-  * liiji'  li.  \ .1  JL’Ol.t 
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II.  III.STOKICAI.  DKVKLOrMKlNT  OF  THF  iMODFI. 

rile  cHinituil  "Nlax-MiM  Model''  lor  olleti>ive  -tialefiie  '\'-leiii>  v\a'  de\elo|)ed  li\  I'hipps  !M. 
Hestiictin^  III'  atteiiliori  lo  'iirx  ivaliiliu . Ii<-  a>'-iini<'d  tliat  iiils'<ile  '•\'.|em'-  could  lie  liroken  down  into 
two  lia>ii  Ivpei..  I lie  lirsi  class  is  comprised  ol  s\stene  that  aic  diiru  ull  lo  locate  Init  coinparaliveK 
cas\  to  desiro\,  once  located,  l’()l.\|{|S  is  an  e\ani|ile  o|  such  a svstem.  1‘liipps  coined  the  name 
percentage  Milnerahle"  lor  s\»tems  ot  tlii-  clas'  liecaiise  a fixed  ell’oit  h\  an  attacker  would  hrinj: 
under  attack  a fixed  (icrcentatic  of  tin-  retaliator''  weapons  lieloiininii  to  the  r th  'N'ti-in.  indi'peiident 
of  their  niiniher.  riiiis.  the  'iirxixinn  liMr  lion  ot  weapons  (platlornisi  for  this  s\»|ein  is  e "i«i  where 
II.  i-  the  \ uhleiahilitN  of  the  'V-tein.  rile  exponential  lorrn  useil  lii-re  is  hased  on  Koopman's  theory  of 
landoin  -earch  | I | . 

h.ach  of  the  cxleii'ion-  ot  IMiipp-  tnodrd.  iiu  ludin^  the  nioihtii  ation^  pif'cntcd  here  also  restrict 
.illeiition  to  »uiu\ahiht\  I he  niethod  ol  -oliKion  |iiesented  in  the  next  '•ectioii  l aii  he  moddii  d lor  an\ 
draw  down  oi  piohahilitx  of  'iirxixat  ciiixe.  Ihiis.  inoililicatioiis  to  inchnle  petietr.ition  -lioiild  not 
irixoKe  additional  coinpntatioiial  dilhculties. 

I he  other  class  i otisisis  of  systems  which  an-  eas\  to  locate  hut  ddhcult  to  destrox.  e.^:. 
MIM  IT.M  Vs.  I Ik-'c  s\»|enis  vxere  laheled  "numerically  urhicrahle'  hecaU'C  tiles  lind  'aids  in 
niimhcis,  Mlossinn  fractional  leentrs  sehiclc'.  the  fraction  of  weapoii-  'Uisivint:  a harrace  attack  d 
(■  "i"i  'i.  where  I,  i»  the  letaliator  - lesel  III  eflort.  rem[ioraril\  we  -hall  coii'idei  the  ‘ Icsel  of  etiort". 
I and  1,  for  each  /.  lo  he  cxpre--ed  in  dollai". 

Iieatiii”  iiiiiiiei  i(  alls  s iihicrahle  weapon-  a-  point  target-,  the  coirec  i -iirsisal  prohahilits  curse 
li.c.  mil  allowing  fractional  icentrs  schicicsi  is  a hiokeii  line  who-e  i oriier»  fall  on  an  l■xponentlal  curse; 
however,  the  exponential  is  an  excellent  approximation  to  the  hiokcii  lim-  lor  lea-onahls  si/ed  siilner 
aliilitic-  II  I’liipp-  (71  di'cii'se-  how  these  s uliieiahilit s parameters  can  he  esahiated 

I oi  a tiiix  of  1/  |iercentat:c  siilneiahic  sssieiiis  and  \ U niimericalls  viilnerahle  ssstenis.  the 
'UtMviii>:  "sahie  " of  the  mix  i- 
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where  I,  is  the  sahie  or  Imiin-  of  incut  "if  th<  /th  -s-i, in -- expressed  oiieinallv  a-  a cosi-i|)ecli\eiiess 
|iai  ,1  meter . e.;;.  nieeatorina|ie  per  ilollai  ( haii”  per  luick  l.  ■\pplvme  a eoiisers  at.v  e -i  i alees . t he  oliieetise 
of  this  model  is  lo  deteiimne  the  optimal  allo<  atioiis  i ‘ and  v * sneh  that 

/ ‘ I \ * 1 min  I'll'.  \ I max  mill  / M . i i 

I 1 1 
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I'lilortunalely,  altliou^li  Phipps  (leveloped  this  iiioclcl  (just  hefor**  leaving  OE(i-NW(i)  in  1%0,  it  was 
not  solved  until  Danskin  [2]  published  his  honk  on  Max-Min  in  l%7.  Independently,  in  1%.')  Matheson 
[M  considered  a Lagrange  multiplier  approach  to  s(dving  this  problem  in  some  informal  working 
papers  and  showed  how  the  percentage  vulnerable  systems  can  he  replaced  by  a single  e()uivalent  sys- 
tem. Me  also  showed,  for  4,  how  regions  of  the  feasible  set  may  he  lormulaled  according  the  mix 
of  nonzero  systems  in  the  optimal  allocation. 

One  of  the  biggest  drawbacks  to  this  model  is  its  assumption  that  all  systems  are  bought  from 
scratch.  This  was  all  right  in  1%0;  however,  by  1%,'v  some  systems  had  already  been  procured  and  this 
should  influence  the  results.  To  formulate  a more  realistic  model.  !^here  and  Cohen  [ I0|  took  aicount 
of  development  or  buy-in  costs  anil  .Shere  [Hj  further  extended  the  model  to  also  include  prior  invest- 
ments. During  the  parameter  evaluation  and  computational  phases  of  this  work.  .Shere  noted  that  the 
cost-effectiveness  parameter  r,  could  be  adjusted  to  influence  the  result'  by  using  various  methods  of 
costing  the  systems. 

( ionseipicntly.  the  model  was  further  modified  to  explicitly  rc()rcsent  future  costs.  Kedefining  >, 
to  be  the  number  of  retaliator's  wea|ions  lor  platforms)  in  the  ith  svstcm  a)id  to  be  the  iiumbci  o| 
search  units  or  reentry  vehicles  attacking  the  i th  system,  the  siirvivi)ig  ci|ui\alcnt  megaloiinagc 
iKM'l  l of  the  force  mix  is 


(I) 


/•  ( 1 . V ) 


w 

^ ;c,«,e 

I I 


\ 

I U • 1 


where  /( , is  the  KM  I per  weapon  or  platform.  The  measure  of  effectiveness  could  also  be  throw  weight. 
c(|uivalent  numbers  of  ,50  Kf  warheads,  number  of  reentry  vehicles,  kill  potential,  etc.  The  kill  potential 
is  a measure  of  the  effectiveness  of  a single  reentry  vehicle  against  targets  of  a specified  hardm-ss. 

The  attacker  and  retaliator  need  not.  of  course,  use  the  same  measure  of  effectiveness.  For  ex 
ample,  the  attacker  may  want  to  allocate  his  resources  to  minimize  surviving  KNI  T,  whereas  the  ic 
taliator  wants  to  maximize  the  surviving  or  residual  kill  potential.  I'hat  is,  subject  to  the  consnainis 
specified  below  wc  must  find  i * and  a function  \*  such  that 

(2)  / ( V.  V *(  « I ) min  /•  ( i.  » ) 

V 

and 

I d I f/'(  V*.  V * 1 1*  ) ) = max  fr  ( » . V *(  > I I 

V 

where  f<(».  vl  is  given  by  the  right  hand  side  of  ( 1 1 with  the  KM’f  per  weapon  ii , replaced  bv  ihe  kill 
potential  per  weapon  d»,.  Ihc  information  available  to  the  players  reipiircs  the  retaliator  ii-|ilayerl 
to  allocate  h|s  resources  first,  then  the  attacker  (»-playerl  allocali’s  his  resouices.  Moreover,  the  le 
taliator  knows  the  attacker's  measure  of  effectiveness. 

There  are  a variety  of  constrainis  that  can  be  imposed.  Let  be  ibe  total  funds  available  to  the 
retaliator  over  a spei  ified  time  frame  and  let  lie  the  funds  available  to  the  attacker.  Vi  ritiiig  the  c os| 
(ler  svstein  as  the  sum  of  the  operating.  inv<-stment  and  buy-in  costs  we  have  for  tbe  retaliator 
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(4)  V I (»,U,  ‘ >, ) 2 • i>,  max  (II.  >,  i,i  • (/  ' Hj 

I I ' ' 

wlicrr  (),.  !>,  and  </,  n-vpcciixelN  (Iciinlc  tin-  ii|i<-ialiti;j.  [iiiicutrinciil  and  l)U\-m  ( o'l'  |ii'i  VM-a|Hiti  m llic 
(ill  system;  t,  i-  ill*-  mimlifi  ul  u('a|»iii"  at  llir  cud  <>l  the  lime  iicrind  and  i.  i'  the  cxi-l.'i^  <>i  imllal 
mimlicr  ol  wcaiiim-.  Ndic  that  i/,  II  :!  cilhci  i 0 i>r  i,  H;  dihi  rw i^c  it  i'  piivitiM-.  a fir-l  allcmpi 

III  include  the  ellects  <i|  phasing:  'V^leiii-  iiiln  and  mil  nl  the  Imee  'Inn  line,  a emi'laiil  rate  n\ei  the 
entire  lime  periml  wa>  as'iiiiied.  I In-  i'  rellecled  in  llie  uperalin;:  en-l  ealclilal imi.  ()lhtr  pha'c-in 
rale>  could  he  um-iI.  h'or  example,  opeialin^  eo'l>  ol  the  / th  '\-lem  coiiid  he  k,i  i,  • .'h,  I I.  In  actual 
applications  we  have  lurlher  extended  ihi'  iinxlel.  hut  are  not  prc'eiilini;  the  ic'iill'-  here,  to  a< count 
lor  lil  time  la^'  hetwceii  procuremeni  ol  platlmnis  and  deliveiv  o|  plalloini'.  iin  the  |( )(  dale  lot  new 
sy.stenis.  and  liiil  manuiacliirin^  capahililic'  iholh  annual  l apacilv  and  a niimniid  annual  piodiiclion 
retpiired  to  keep  pioduction  line'  inlaell. 

,\  'imilar  eoiistraint  lor  the  attacker  i' 

IS)  V 

I I 

or.  mole  hriellv.  I III*  A’,,,  where  I i \ I i'  the  ipianlilv  'co'i  to  the  allac  kei  i denoted  hv  tin  lell  hand 
'ide  ol  (.11.  I he  allackci'  i o'l'  aiiani'l  a mohilc  'V'icin.  loi  examph  . .in  tin  > o'l'  o|  opeialinj:  a -can  h 
and  procuring;  more  'carch  iniil'  Om  e ihe'c  paiametei'  an-  'pe(  ilicd.  ii  i'  noi  net c"arv  to  '|'ei  il\ 
ihe  |iarlicular  lorni  in  which  the  'carch  take'  pl.iee:  i.e  . we  can  think  in  Iciiii'  ol  the  unit  ( o'l  to  an 
adver'ary  |o  'carcli  a fiivcii  area. 

rile  allacker's  developineni  co'is.  in  Kipialimi  i."ii.  aie  i}:nored  hn  'i  vi  ral  ri  ii'oiis.  Kii'llv . allai  kei 
systems  Used  in  a counter  lorce  role  can  p'lierallv  al'o  he  ii'i  d in  a counlei  value  loli  n.e..  aj^aiii'l 
urhan/industrial  larjiel'i.  < .oii'ei(uentlv . the  lorces  dc'crihed  in  ihi'  model  lepie'eiil  milv  a pmiion 
(I  the  attacker's  total  lorcc'  II  a 'V'lem  i'  u-ed  in  hoih  lolc'.  it  would  he  impo"ihle  to  'pei  ilv  what 
portion  ol  the  development  < n'l  is  eharjreahh-  to  one  lole  or  the  other  riiii'  it  mii'l  he  leali/ed  that  the 
attacker's  hiidtrel  specilii'd.  A’„  is  milv  a portion  of  hi'  total  hinlj:el.  \nolher  lea'oii  that  llii'  a"iimp 
lion  is  coiivenieiil  i'  the  extreme  ditliciiltv  in  l•'llmallll^:  huv  in  l ost'.  I rmn  the  lelahalor''  viewpoint, 
this  is  a coiiservativi  a'Siimplion.  t.eiierallv  llioueh.  new  advi-rsarv  'V'leiii'  can  he  i omp.iied  in  leriii' 
ol  the  V iilnerahilitv  to  the  retaliatory  'Vsicm  and  lln'  co'l  to  the  at lai  km  I hi'  i'  illii'l rated  hv  h ieiiie  I . 


Uh  I V • 1 I - 


max  Ml.  V 


V I 


/'i/ 


f l«.l  I < m1  i,t  vx  t«>  * M'lMit:  -vvi,  m 


ligiliiUiiliiiiii 
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In  addition  to  the  budgetary  constraints,  there  are  arms  limitations  imposed  hy  international 
treaties.  These  constraints  for  the  retaliator  on  his  total  number  of  launchers,  his  sea-hased  launchers 
and  his  land-based  launchers  are,  respectively: 

\ 

(6) 

i i 

( 7 ) ^ .'i , I , •£  .S'  I 

„\t, 

l«)  2 .v,i,5=.S. 

oW 

where  \f,  and  \/j  are  disjoint  subsets  of  { 1 V}. 

There  are  various  other  constraints  also  imposed  on  the  retaliator  to  make  the  model  more  realistic, 
for  example, 

(•J ) =/,\,  I lor  i'-  2.  4. 

where /i  is  a positive  constant.  Ifii  were  the  numbei  of  Brand  I boats  at  sea.  then  would  be  the  num- 
ber of  Brand  I boats  in  port.  Sometimes  tbe  size  o(  a syst<‘in  is  inllueneed  hy  political  factors.  Thus, 
there  may  be  constraints  of  the  ty|)c 


1 10) 

»:i  is  a given  constant 

111  1 

7 s:  « , ^ 1 ,7 

or 

TBI  if.-.  >0 

I IL’I 

0 it  0 

(!onstruint  ll2l  says  that  the  numlier  of  w<-apon~  alloeale<j  to  s\^ii-m  (t  is  at  least  4.'f0  unless  system 
has  been  pliased-out. 

Ilitberto  onlv  missile  systems  have  been  discussed;  however,  bomber  sVsIeiU'  mav  also  be  in- 
cluded. Dr.  Alden  Turner  [ I I | of  the  Tenter  of  Naval  Analysis  recently  developed  an  empirical  lormula 
by  analyzing  simulation  data,  for  the  fraction  of  surviving  bombers  of  the  form 

I l.'f ) I — /»,  an-  tan  u,  v , 

w here  v , is  the  number  of  reentry  vehicles  attai  king  the  bomliei  bases  lor  lioinber  type  i and  h,  and  u 
are  posilivo  numbers  depending  on  the  number  of  bases,  reaction  time  ami  deiisitv  of  attack.  Of 
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courst*.  tiu'  fraction  I l.'fl  is  replaced  l)V  zero  when  \,  is  larj:e  enou(;li  to  drive  tlie  fraction  nenative.  I >.in>; 
Turner's  results  we  could  replace  ll)  hy 

\ \ 

(I  ) /•'(<.  \ ) ^ n,(,e  ^ ^ ^ /c,»/(  I ~ l>,  arc  tan  ii,\,  I 

I I I \ I ■ I I \ 2 • I 

for  a complete  des(  ription  of  the  triad. 

In  the  next  section  wc  des<rihc  the  method  used  lor  solvitif;  the  proldern  dc(ini-d  liy  lll-(lL’l. 

III.  METHOD  OF  SOLI  TIO> 

rile  intifT  prnllirm  is  to  Imil.  ^iven  >.  a point  \ *(  i I winch  ininimi/cs  / I i . it  sulijecl  to  the  con- 
straints on  1,  The  ot/.'e;  /uo/i/em  is  |o  find  a fioini  »*  whnh  ina\inh/cs  f,(i.  suh|cct  to  the 

constraints  on  >.T(>,  I'lill  is  a well-defined  ipiantity  since,  a^  will  he  seen  later.  >*(  i I is  uniipie. 
The  existence  o|  i *1  i ) and  i * is  csiahlished  hy  ^iiitahlc  continnitv  and  cornfiactness  arfJtunieiits. 

Two  approaches  to  optiini/atioii  proldeiiis  are  1 1 1 to  apply  anaUtii'  criteria  to  i alculate  an  o|itiini/.int: 
point,  and  l2l  to  use  a numerical  scheme  — often  an  iterative  one  — to  find  a point  accefitahly  close  to 
the  optimum.  The  second  afifiroach  Generally  requires  manv  lunetioii  evaluations. 

.As  a lunetioii  of  1.  Til.  i*(ill  is  eoiitiniiotis  and  piecewise  eontimioiisly  diflerentiahle.  The 
locations  Ilf  the  di-eontinuitic'  arc  not  known  m advam  e since  thes  depend  on  \ *.  that  i».  on  the  j;eneral 
solution  t.  I'le  inner  prohicm  roiiseqiicntlv  we  did  not  find  the  oiitei  [itohlein  atiaivtieally  tractahle. 
ill!  the  sfiecial  case  in  winch  onlv  (icrcciitatie  viilnerahlc  svstenis  appear,  there  arc  no  hiiv  in  costs, 
and  /■  = T.  the  I it  net  ion  /■  h.is  a saddle  fioint  i namciv  ( » ' . i ' I i * i i and  .i  I acranyte  iniiltiplicr  apfiroach 
can  he  Used. I I'or  snlvitiy;  the  outer  prohicm  wc  iiscil  an  itciativc  scheme  which  will  he  dcscrihcd  later 
III  this  sect  i<  III  Quick  e\  a Illation  o|  T i i . i ’ i i i i — .ind  hence  of  I ‘ I I 1 - is  required  lot  »ui  h a seln  rue 
to  coiiveryie  in  a reasonahle  ainouiil  of  tune  I ackinyi  a yieneial  solution  of  the  inner  piohlcin.  we  solved 
It  lor  each  I leipiiied  iisiiif  a I ay:iani;e  multiplier  tei  hniqne.  ohiannnp  .in  ex.n  I «ohilioii 


Solution  of  ihr-  lnn«*r  i’rolileni 

I r-I  / he  defined  hv 


/ I I .1  I 


lol  I I . . U 

lot  / W • I . . N 


.ind  y,  hv 


that 


V. ' 1 I ^ (1),  IV  • V I • rr  max  i T.  v v , 


I 1 . V I V f I I . V I 


111  V\,iv,i  - Hi 
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Each /,  is  convex  in  its  second  argument,  and  each  >(  is  convex,  so  that  the  attacker  is  faced  with 

a convex  programming  problem.  Let  H be  the  set  {>  : v,  ^0.  i = 1 V}.  Consider  the  problem 

of  finding  the  point  > (jr,  /x)  which  minimizes  h ix.y)  > ‘*'*“*^  I'""  positive  fi.  Then,  according  to 

Everett’s  Theorem  1 (3|.  y(x,  fi)  minimizes  Fix,  v)  over  /'  subject  to  the  constraint: 


L( » ) « l'(  > (x.  /xM. 


I (v(.t,  /X ) ) is  monotone  nonincrcusing  in  p.  Krom  the  strict  l onvexilv  of  /xl  in  \.  it  can  be  shown 
that  I (v(*.  ^))  is  ccmtiniious  in  fx.  aiul  that  \ix.  fx)  is  iini<pie.  The  ei|iiation; 


I I t ( I . ^ ) I H ^ 


is  -olved  lor  p a-  lollows: 

'I'be  ininimi/.ation  off  • ^1  wiib  respe<l  to  \ ^plit^  into  \ -eparatc  miniini/ali<>n  problein».  since 
F • /xl  is  st'parable  in  ».  and/’  a cartesian  product 


min  V I /;(  1 , . » , I • /xy.l  > 1 1 V iniii  ( /,  i i, . i • /xy,  i t i i 


•\  simple  calculation  then  shows  that 


t . I . ^x\ 


1 ( 

log  itiax  I . - 

" I M'. 


Ill  I 0,11,  id  I I 

j.ma\|  I,.  log  max  I I.  |||  lot/ 


■ > ' I , " " *1  I . w 

itiin  log  max  I,  - .max  i.  log  max  I . / loi  i t/ 

( o , I M ' 1 ' I p ' I I 


where  1/2  (o,  • 77  . and  i 12  <o  mde's  V •>.  when  s I 2 ik  • rr  ''cc  figure  2 lot  ,i  sketch 
III  i,U,  xersus  log  fx  riiis  Innction  is  piecewise  linear  and  iioiiincn-.isinj;  m loi;  and  bem  e I mu,  ^ n 
|s  also,  rile  xalnes  o|  ^ corresponding  to  corners  o|  tins  jirapli  an  easdx  i .dciil.ileil  Itom  the  condition 
that  exact!'  on*-  o|  the  one  sided  d*-ri' atn*-s  w ilb  n-spei  i to  i .,|  / m ,.  i i • ^ v m i i > siri(  led  to  |().  1 1 


xanislies  at  a l orner  [loiiil  f.ipialion  ■ 14i  i'  sol\ed  b'  lira*  ki  ting  /V„  heiwi-cn  ,i  pan  ol  cornel  point'  .ind 
solving  a lineal  (-(ptalion.  lip  ‘ n ,i  solution,  t 'm  i »'  < . p ' 

I ppi-i  and  lower  bounds  on  i > an  easilv  b*-  iii< orpoi at>-d  into  die  'ohilion  — lliev  s|in[>l\  add  rnor*' 
corni-r  points 

•\s  long  as  die  solutions  io  do-  on*- <lim«-n'ion.il  mriimi/.il ion  piolilcni'  i .in  be  obt.nned  snnnlv. 
.|s  III  till-  case  presented  ami  as  m the  ,ir<  tangent  lorin  used  in  I b.  the  si-lntioii  ol  the  inner  problem 
can  b<-  rediic  -d  to  die  solulion  ol  - ne  eipiation  m one  iiiikiiown  In  gener.d  tin  eipiation  niav  not  br- 
linear,  so  d-.al  the  iiilerpolalioti  proo  dun-  max  liax<-  to  |«-  repl.icetl  bx  some  odn  i irn-lbod.  not  nei  *■' 
sarilx  bx  one  giving  an  exai  t sidiition 


The  Outer  Pr«>l»lem 


'We  solved  tin-  outer  problem  bx  <1  two'stag*'  pro*  *-ss  |n  tin-  first  'tag*-  '••xii.il  bundr*-d  l*-asibl*- 
points  r"  ' ‘ ' w*-r*-  geii*-rat*-d  at  ramloiii  anil  for  " . x *m'  H.  . t.u  . x * i ' ' n l■xaluat*'d 


I 
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The  \ • I lifsl  poinls  werr  used  as  an  initial  cninplcx  <tl  [i'iinl>.  Inr  a variation  of  Ifox's  scarcli  mctliod 
|l|.  Hoili  proctolurrs  arr  df>«<  ril»cd  in  dotail  in  a ••(■paratc  document  |'^|. 


f li.(  f ’1..J  .•!  A I , \ * Im^:  ^ j.it  .1  }►«•» » ♦•ntdi:*  v ultt*-r  vv  *!m»i 


l\.  CONCl.l  SION 

We  have  pri'etiled  a tood'l  let  alloi  ation  ol  t<»iooi  i to  olleii-iw-  >lrale):ic  .s«ic-m»  dial  can  lie 
ii-ed  to  reali'lic  ail\  ri  flee  I the  loin;  ranti  planning  firo<  e»> 

's|ilH>o'e.  lor  i xanipli  , dial  die  planner  i i-  . dn-  letalialoi  want'  lit'l  lo  oliiain  a ■•peeilieci  i apa 
lidilv  auaiti'l  hard  larter-  and  -ei  ondlv  lo  inaximi/)  hi'  'lUMviip;  fMI  Hi  can  ii'c  die  niodil,  h\ 
I haiiumt;  die  ohiei  ti\e  luni  liori.  to  minimi/e  • o'l  i oii'iraineci  to  .1  Iiom  i hoiiiid  on  'i..\iMnt:  kill 
poleiilial  I 'in^;  die  oulpiil  lioiii  dii'  pioidein  a>  dn  in|Mil  ol  die  lelah.iloi  'V'lem  lovser  I'o  ind'.  he 
I an  tin'll  inaximi/e  'iiiMNiiit:  fMI.  proMiled  the  iinniiniini  eo't  re'iillint:  Iroin  die  Iit'I  'lep  i'  li"  lhan 
hi'  hiidcel 

I In-  plaiiiiei  non  Iuim-  ihe  nii"ile  tor  1 ai  h iNjn'  o|  '\'|<-ni  1 aleuori/ed  a'  U'c  liil  auaiii'I  hard  lartir'l' 
ol  ii'eliil  anaiii'l  'oti  laryel'  II'  »anl'  lo  inaximi/e  'urviMii):  kill  poleiiIi.il  hn  the  lii'l  urmip  ol  mi' 
'lit-'  and  III  maximi/c  'iirviMiit:  fMI  lor  tin-  'ci mnl  rinnip  llenn;  pri'enled  with  .1  mull lenlerioii 
pi'ddein  lln  (ilaiinei  niii'I  dec  ide  die  t\|«-  'tl  ••|iliniiiin  In  ilc'ire'  for  e\am()le.  In-  can  lake  a 1 mnev 
c oinhiiialioii  o|  die  Ivco  1 rileria  a'  hi'  "hiei  li'e  liineincn  \iiolher  .iiipioaeh  i'  lo  tind  the  I’aielo  o|itiimiin 
|ioiiil'  I III'  c an  he  done  lo  i'  '"Uiiii;  lln-  kill  (coleiilial  prohleiii  11:1101114;  'iirvnin>;  KM  I and  'in 
iheii  'oKinj:  ie|iealedU  lln-  "fMI  piohlein  while  imiio'iii^  liewer  hound'  oil  die  kill  |io|enlial  ranuint; 
Irom  zero  lo  die  aii'wei  ohiained  III  'lep  'i>  I he  planner  imw  ha'  a ranvie  o|  I’arr-lo  oplimal  oiilc  nine' 
III  1 .111  dien  c tioo'e  a (lartieiilar  Ion  e mix  l"  ad'oealt  ha'ccl  on  other  eon'ideralioii' 


• 


M I (»(  \ riuN  (t^  HI>ol  H<1>  93 

V.  A<:K>OVn.KIX;K,IVIK.NT 

I he  aullmi'  thank  Jnlm  I’.  ( .n\  Ir  i ( N<  I \(  >1’  (tOs  \ i Im  inatu  (h-.i  U'^iini-  rrlalmj;  In  tin-  mndcl. 

KKKKKF.NCKS 

|1|  Ihix.  M.  I.,  \ \iw  Mrtiiiiil  III  ( iin-ti.iiinil  t l|>tiini/aln>n  anil  at  iiin|iari-nn  tn  ( )tli<-r  MciIiimI-. 

( .iini|inti-t  Jiinrnal /I.  IJ  .iJiI'Xmi, 

IL’I  Dan-kin.  . I.  \\..  TIirTfiriir\  11/  Mill  l/in  i.'-|itini;rr  \ rilaj:  ln<  . \i  w 'imk.  l*Ali,l. 

IM  I'.wiftt,  II  , III.  "I  ,ctiirali/r(l  I a>;tan;;i'  Mnlti|ilni  MiiIiihI  Im  .'-nKirn;  1’tnhli-ni-  nl  t)|iinnnni 

Mliii  atimi  lit  Hi  -iiiiii  I -.'  < t(ii  tatiiin-  Iw  -rati  li  II.  II. 

|l|  Kiiii|iinan.  II.  ().  I In-  Ihcms  nl  '-I'.tn  h I,  ( liiiratiiin-  l{i-ia:i  h /.  IJl  IWii|‘t>tn 

|.)|  Matlir-iin.  I D. . |ii i\ ate  I I iin ninnn  .itnm.  I'Mi.i 

'ti|  l’ln|ili'.  I I.  . )|i|  I nniin  Mlmatnin  nt  l.llmt  Im  Dil'i  imn  i- , ( >|iit  .it  n m-  h \ .iln.ilimi  <.imi|i  — 

N ,i\  .il  \\  ai  I an-  \n,il\  - i-  < - i mi|i  imw  a iIim-ihIi  'il  tin  • mitm  Im  N ,n  .il  \ iiaK  - r-.  \ 1 linulmi.  \ ,1 

J-’JIl'ti.  OKI  . \\\l.  II  tiH.  I \la\  I'ttill 

|7|  l‘ln|i|i-.  I I.  '(t|i|iiMnin  ‘-\-lcin-  ( linn  1 Im  ->lialri::ii  l!>  l.ilialimi  \n  \ |i|iln  at imi  "I  M.ixMin 
llii-mv.  N.u.il  tliilninii'  l.ilim,ilm\  I 11  linn  ,il  I{i'|iiii1  \t)|  lljn,  i‘t.  I‘<<), 

K|  -111  |i  . K D ■ \ 111  .i.mri  \ll  IM  .ttl*  Il  I Willi  M»-\ Ml  ( .tllii  l*fl"r  hlW'-'tlMrllt- 

N .1  \ (iH  < I ii.i  M'  * I .iltt  ii  <il  Ml  \ I r*  Imi*  .1!  lu|»Mi  I \(  l|  111  , I 1 K'^.  I . I 

i*^  lir  n k h ■■  I In  1 I mi/.tl  iMti  \ji  ! IuhI  N .1  \ .il  Hi  iIm.iim  f I ill iMt  ,ii mt  \ I rt  Im n lU-|*Mrt 

\ni  ii;  :\  Ml.  \'>:\ 

11*1’  'Inir.  K I*  .IM'I  < Mlirri,  f-  \ " \ 

K—  I MU  I .r  rrj 

I I I j I m h*-i  \ . pf  I V ii*  1 MMiiimiiM  .If  iMfi . I i 


.ifiMti  Ml  Aitl)  1 )t  w htpmt  Ml  * 


l»KOJE(  T SCHEDI  IJNC.:  THE  EKEE<  I S OE  I'KCmi.KM 
STKl  CTl  KE  ON  HEI  IHSTK  PEHEOKMAM  E 


I » i»i»  >■  II  I '.it  I*  r «•  N 


‘ ' \t  •!>  n:»  ni»  • ■ . n • ,i'  / ' . - i' 

Ml'  {''  • t.  • \ < ,in  •'.'wf*  i • . • V 


ti>t.«n'iii  t ill  ••  ’li  .i'- 

It*  ♦ \ 1 fli  I .<  I I t ' I*  1 • tii|i'  * • |»t  * ■ i ' ' t * • . . I,’  I -i  ; .III'.!  t - M • t '(♦■III*'  'I i»- f t ..  J . 1 »■ 

• • iiH  lit  t . » . I.  j..  » • ••  tn.ft*  • * • ' • 1 ;•»  I . ,t*  - • ■ 1 1.-'  • • • ' .1 

. 4;:*  ..  I - »-<  J|  ..  I-.;..  .1  I .•  J" . .E*  ti:  ti»  *’  J..  *1  ,•  . }...t  ( • ■ t ' u 

.|t|«  • ' • r ' . • V li'  I *1*  - f .1M*!  I*-.'**  -1  1*  It.  - 1'  . ■ * • **  \ •*  •*  ■ ri 

, I..,.  • . It....'  ..  - ■ .*  j.'  ..  . .1  (t  . 


I.  IM  KOIM  < I ION 


Ct 

II-  'III' 

1 . - ’ 

* :••  • ’ ’ a 

'll.  . 

!'  . ' 

- • I m- . a ' 't  • li.i  1 a 

! * r 

• 1 1 . 

. j M,  ■ , 

pri.. 

nl  1 .1  - 

p.ii.  1 - 

. .pi. ... 

Mil*  - 

...... 

’ f ' 

t > > ' 

.1  *li  • M 1 ■ 

f.* 

... 

■' 

In  a 

Uf'-Ul- 

« il  a ' n \ it  t*  - a ' 

' It 

• nat>'» 

1 

1 1 1 . VS  * , ’ * ‘ . r \ ' h • * . 

-lilt 

'll.  - ..1  . 

1 1 » • 1 1 

anal\ 

. .1  -■  ,• 

, .... 

* IV 

■ )• 

p.  ...i.  • .1- w 1 >1 1 ■ 

* r 1 , 

p...„  .1-  ...  . 

i:»-n» 

■t.llr.l  ■ 

• n a < *' 

inipii'.  ’ 

I'l'!  '!i*  |. 

. vl.  (I.l 

. . 

n ‘ 

a.t  .V  i ' til  : lata 

"1  ' , 

nil* 

'!  M**n:  a*  ! 11 

pr... 

In*  H * 

•f*  U-*  < 

■ 1 

W li.  1. 

■ Ull'l.  1, 

.1  p' 

M w . - . . 

V a ni  1 n* 

-1  ■ ' 

• • 

' «n  t ' vs  • ’ « n»  t a ' \ n*  •!  \ • ’ \ 

-.iti 

i-Ia- 

I..* i 1..  . * 

1..r  . 

v.iinpl. 

i-M  ' .f 

• \ f . ? 1 - . * 

» ' a I. 

a' 

..  ■ 

n . * * ! • ■ - ' f) » ' Vs  ■ ' k 1 1 • ! ’ » - 

• 'll  ■ 

. ■ 

!■  n a*  1*  * '■ 

• n a 

hrf  na^  ‘ 

in*  ’ti- 

,i-  ,, 

. • .l.lllllt 

' n ' 

• . 

« pf  I*  * » f*  • vs  ' * - II'** 

vp. 

* nil* 

n t a !i*  I * ’ 

. . .11* 

i-I*  i . 

I 1 - I ■ 

1'  ‘ (T- 

' a ' \ ^*  1 

It-  ■*  in 

! w • 

r..  M 

M’  - »■  • ’ 1'  . 1 ; - !M»  a • nr  * - 

- t vs  ■ 

• r k 

ti*«n 

.111.1 1. 

-..lit'  ♦ 

•I'a^:* 

1*111  in  ’ 

TK  \Kt 

' inn 

I*  * . 

p»  ’ ' ♦ 'tij*::  '•  V ,1  ’ V E 

. ■ .rnpl.  V . '1. 

-It  \ 

t. 

-••ijn  » 

liii.'i  r 

• I w * r * 

, ...  t . 

a'  I*-' 

J ..\* 

r * ^ 1 r » » I » \ * • 1 - r . • . > r ■ - ' * 1 1 . ' ■ ; . ; 

'll* 

',*■ 

Ms  t K ' f-  .1 

iKlt^-irk^.i';  ’I's^irl  it*'i  »*\*f*.-  .'.i*-  win  |w 

1 1*  *t j J u ri*  1 1 •!  - ( I ■ *1"  ' ' • * .i*.*  I f:  5*r  • *1*  ' ■ 1 II ' ,0|i ' ' • I-  ! !••  . jM  • ' • . ' . 1 i ' i - w » • . 

m V »•>!  1^ jO-ii  f -f  r."M  •!•«»  fi\»  fu:i-  !i**»i'  t»»  •fl*  • ' ■ oi*  » r tn.i  \*  - v.iri.in-  * w.»- 

r » **om‘  r li Mill  .r  i"f  I . ■ I'  l!  - N ' -tn I *l»  \i’  \ pf  • • • n'  ii:»  •'  i .i r»’ n*  . i ' ■ > in  1 • • |ii»  n-  < i » ! » ' 

wiifi  fin  iallrr  (>♦  in;.  •!  r*  i.i!iw  j\  rnm--*  rnj'  ••’’.iin  • I i '••Miin.i!*  s M»»  •!•.»  ' • 'ui  • 

; n»n  • «inl  !!•  «i  \ .ir  N ' v^  ii  I Mi»  ' * N*r  i.i  r t|.  n • i i h ’ .i-  I *,i  >.  i»  • ■ » p*  - i • * * I i * : t •*  i * w .i  *.  n • u:n  1 1 

■ an!  I . .ji  I iH  o M , )f  w (.«■!  w *-»  1 an  \ j»a n ni*  an-  !••'  ' ti'  ’ i i*  t a - ♦ -1  ' n n*  1 1-  ■. 

W ITmm  * ’ I a*  • I I ♦ . >*  » f I •!  aim  *t  ' ' • • a * . a j '•  a ' i*  • ’ tn  ’ • - n ' - n a » » j ' -u  t a;:i  n, 

IJ  I tif  f ♦ lia  V * > . • I ' •*  * ! ! Ill*  I * -I ' lU  ’ » - nlf  * v^  h»  I.  *n  \ : - a'  ’ • Mn  . I i!  a a - • > t w i-  ; ■!  a.  n»  - 1 ^ • i 

f ir  ai  I n • I Ki \ i - ' ' - r * \ a n | •!»  \ l-'•i at*  *1  -»  > ♦ r a - nn  i"  o \ m*  i - ir » - •'  ' m ' w . .r  . ^ v 1 1 

' I.’, 


Preceding  page  blank 


I il  I’MIKUMIN 


M-'iiUK  r III  .III  atlriiipt  to  |iri  ilicl  llii'  |«'irfiil  ini n a'c  in  riilii  al  palli  ()>.ialiim  that  loiillfd  v\licii 
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mciliiiiii  rniivi'icil  III  2(Il’  difiririil  'iiiiilf  priiifi-i  iicUMirk-  '•iilvril  iiiidi  i a varictN  nl  rr'iiurcc  limitatinii^ 
w liH  II  \ n'liiri)  7l’  I Ic't  priililriii'.  h nr  tin-  nn*-  'cipifiK  in;;  rule.  I )a  \ i'  ili  i i \ rd  ■'i  \ cral  mullipir  ri';;i<-'>iiin 
mndfU  liir  prrdiclm;;  llw  prri  fiil  iiirma'-c  in  i rilic  al  fialli  diiralinn  diir  In  liinilcd  rt'Miun  i’  availa- 
lullin''.  F!.ii'li  niiidi'l  had  H \alin-'  in  the  nt'i;:lilii>rhnnd  nl  II  8,^  I he  'landaiil  I'rnir  nl  c'liinalc 

III  llic'i'  iiindi'U  wa'  fipialK  nnnd.  Il  iaii;;)'d  Irnin  aiiniil  0.0’  In  0. 1 I , I lic'r  lindin;;i'  dt'innii'liali'  lhal 
Il  i'  pn"ilili'  In  'l.ili'licalK  i'lilali'  prnn'< i 'iiininaiA  nica'iiK  ' lhal  ran  hr  u-rd  a'  a riiidr  in  prrdirlin^ 
hriiri'Iir  prrlnrmani  f. 

In  till'  papri.  dilhriillir'  whirh  an-  nllrii  riirniinlrri'd  will'll  ii'inr  arlilii'ial  pri.ji'i'l-  arr  dr'i  iihril. 
I wn  rrniip'  nl  di"iinilai  pmirrl  l\p<-'.  hnlh  arlilirialK  rriirralrd.  arr  lin  n iiiM  'liralrd.  Mullipir 
I'lrpilnwiii  II  i;ir"inn  I'  ii'i'd  In  pifdirl  lirnri'lir  (irrlni  in.iinr.  I.indrlinr'  arr  llirn  drvrlnprd  Inr 
'i  ln'diilinr  pmirrl  .n  iml'..  \iUanla;;r'  nl  anaK/iii;;  pinhiriii  'Inn  t.irr  hrlmr  rhnn.'inr  a Irrhniqur 
Ini  'ciK iiu;  Il  .irr  al'ii  r.'pnrird 
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hrrn  II  'It'd  pirnnll'K  .iinl  Irpri  'rlit  a r.  li.  rlmn  nl  llni'i  whii  h ha\r  hrri.  Iniiinl  rllri  li\t'  I'li-rwhl'lr. 
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il('s(Ti|itiiiM  III  iMcli  III  llic  rules  m tiilile  I l ati  lie  Iniitiil  in  |hl  iir  in  (12|.)  lies  in  activity  priiirily  are 
generally  lirukeii  lirsl  liv  |iriijeel  luimlier  llur  tlie  inultiprujeet  ease)  and  then  lie  activity  (jel))  number. 
Nil  "ailil-iin"  iir  reselieilule  rul«‘s  nl'  the  t>  pe  investi^ateri  liv  Wiest  [ l.">  1 7 | are  included  in  this  investi- 
^atiiin  liecausc  we  assume  that  each  activit\  i-  cumpleted  within  its  specified  duratiun  with  a cunstant 
usatre  III  resiiurces.  .XctiNities  cannut  he  expedited  (shiwedl  with  thi'  additiiin  (suhtractiun  I iit  resource 
units  rriim  tliu>e  specified. 

III.  IIKl  KISTH;  msCKKTlON  AM)  TIIK  I SE  OF  ARTIFICIAL  PROJFXTS 

In  order  to  exercise  [lurported  lotiic  relative  to  a sp,-eihe  criterion,  a heuristic  schedulinf;  rule  must 
he  aide  to  discriminate  amon^  activities.  This  often  leads  to  dilhciilties  when  data  are  artiliciallv  gen- 
erated. Discretion  hv  itself,  however.  is  .iften  not  suflicient  \s  is  shown  helow.  the  rule  must  have  the 
opportunitv  to  make  resolutions  of  sei|iJeii<'iii(:  conflicts  which  will  have  an  ultimate  hearing:  on  the 
results  ohtained. 

Ki^iure  I,  lor  example,  represents  two  pro|e<  l networks  reipiirinj:  fixed  amounts  of  one  resource. 
The  activities  in  Network  I of  Kipure  I have  iileiitie.il  v.ihies  ol  total  float,  h.ive  the  same  duration 
nhree  time  units),  and  reipiire  the  same  amounts  of  resoiiri  es  ihve  units  |i>r  each  td  three  periods,  lor 
l.a  unit-periodsi.  With  a limit  ol  five  on  t)ie  niimher  of  resource  units  availahle.  application  of  each  of 
the  seipiencinp  rules  piveii  in  l.ilde  I lexeept  on  ot  c.ision.  K Wl  results  in  an  identical  schedule  il 
ties  are  hroken  hv  lowest  |idi  iiiimher  The  prioritv  dispatch  seipiem  iiif;  lule  used  to  sidve  this  prohlem 
is  ridativelv  unimportant. 

It  is  not  dillicult  to  explain  whv  .mv  selection  of  selieduhn^  rule'  result'  in  identical  schedules 
lor  tin  above  prohlem.  Resource'  are  "tiplit  " in  the  seii'c  that  each  activiiv  reiiuirc'  live  units  of  the 
particular  resource  over  it'  three  peiiod  duration,  and  only  live  unit'  ol  the  resource  are  available. 
Onlv  one  activitv  can  he  on  poiiip  at  aiiv  one  time.  Resource  iitii'/ation  over  the  eonsirained-resource 
duration  i'  KKI  percent. 

The  schediilinp  abilities  of  the  prmritv  dispatch  rules  are  ma  .1  function  id  resource  utili/.ation 
aloni'.  however,  I'his  is  evident  in  scheduling  network  I with  a resource  limit  of  nine  units.  The  ratio 
ol  iisape  to  availahilitv  ol  this  resource  measured  over  the  resource-constrained  project  diiratiot^ 
ischedule  span)  is  onlv  .V)  pen  cut,  vet  the  seipiencin^  rules  piven  in  l alde  I sidl  ilo  not  iliseriminate 
aiiioiip  the  activities  in  scipieiicinp  them,  .ind  schediih-s  identical  to  those  obtained  with  a resource 
limit  ol  five  units  prevail. 

Network  '2  ol  Kipiire  I was  constructed  to  illustrate  vet  another  tvjie  of  problem  for  the  sei|uencinp 
rules  ol  Talde  I.  I'he  nia|ority  of  activities  in  Network  2 have  different  durations,  demands  for  re- 
soun  es,  amounts  o|  total  float,  and  so  on.  Hence,  there  are  ample  opportunities  in  scheduling:  this 
second  pro|cct  to  discriminate  aiiion::  activities  in  niakinp  seipieneinp  decisions.  W ith  a resource  limit 
id  six  units,  lor  example,  application  o|  each  of  the  sei|ueni  inp  rules  piven  in  I'ahle  1 results  in  a 
nonidentical  schedule.  I'he'c  results  are  siiinniarued  in  Table  2.  Note  also  from  Table  2 that  use  of 
I'ach  ol  the  seipieneinp  rules  result'  in  a schedule  span  of  ,'f  1 time  units,  even  tliouph  no  two  schedules 
are  alikel  \n  evaluation  id  ihese  rules  on  Percent  Inciease  in  (iritieal  Path  Duration  or  on  I’roject 
\lakespan  (or  on  >.  host  o|  other  criteria)  would  show  no  one  rule  superior  or  interior  to  the  rest. 
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It  is  indeed  likely  that,  for  a host  of  real  and  artificial  problems,  the  choice  of  a scheduling  rule 
makes  little  difference  in  the  results  of  scheduling  effort.  It  is,  therefore,  relatively  unimportant  which 
sequencing  rule  is  employed.  Although  the  networks  of  Figure  1 were  fabricated  to  produce  the  results 
shown,  the  results  reported  are  not  atypical  of  those  obtained  in  examining  smaller,  laboratory  type 
projects.  For  example,  difficulties  often  arise  when  attempting  to  control  certain  values  of  project 
and  resource  parameters  when  smaller,  laboratory  type  projects  are  examined.  Resource  utilization 
is  one  characteristic  which  is  particularly  difhciilt  to  control  because-  of  integer  restrictions  on  the 
availability  and  use  of  resources.  Other  characteristics  pose  similar  problems  when  the  data  are 
artificially  generated.  Considerable  car*-  must,  therefor*-,  be  (-x*-rcist-d  if  tlie  results  of  the  experiment 
are  to  be  generaliz*-d  to  ih*-  typt-s  of  prop-c-t.^  commonly  found  in  praclic*-. 

Project  and  resourct-  sninmary  measures  d«-sign*-<f  to  pr«-dict  heuristic  performance  as  w*-ll  as 
to  indicate  charac-leristics  of  probb-ms  for  which  h*-iirisiic  choic*-  is  liki-K  to  be  unimportant  are  d*-- 
scribed  in  the  following  section.  Tlu-sc  measur«-s  ar*-  int<-nil(-d  lor  list-  in  scbcifiiling  actual  as  well 
as  artificial  projects  and  proj*-cl  sets. 


IV.  IDENTIFICATION  OF  INDEPENDENT  VARIABCES  I SED  IN  PREDICTINi; 
HEURISTIC  PERFORMANCE 

In  this  s*-ctioti.  th*-  independt-tit  variables  which  may  contribute  to  good  lor  poori  beiiristic  (ler- 
formanc*-  are  idt-ntified.  They  arc  divided  into  tlir*-e  cal*-gorit-s.  In  one.  timi-  and  n*-twnrk  based  param- 
eters are  computed  prior  to  critical  path  analysis.  In  tin-  second,  titni-  and  ni-lwork  bast-il  param*-ti-rs 
are  computed  subsequent  to  critical  path  analysis,  'fbe  third  categorv  iticliidt-s  r*-sourct--basei|  param- 
i-ters  which  are  generally  computed  subs*-((ii*-nt  to  critical  path  analysis.  Note  frotn  Figure  I that  a 
multijiroject  scheduling  pndilem  can  b«-  treat*-d  in  tin-  sain*-  manner  as  a sin.iib-'iiroit-ct  scheduling 
problem  if  a dummy  activity  is  itst-d  to  pr«-c*-dc  isucc«-«-di  tin-  beginning  lendingi  activities  of  all  projects. 
It  is  Useful,  bowev*-r.  to  identify  several  sets  tint  simplify  tin-  notation  ii.n-d  wb*-ti  single  \s.  miiltiproject 
parameters  an-  int*-nded.  Table  .1  givi-s  thes«-  sets,  and  otin-r  notation  for  identifying  variables  used  In 
dt-scribing  the  various  probl*-m  characteristii  s examin*-d.* 


I.  Time  and  Network  Based  Parameters  (]om|>uted  Prior  to  ('.ritiral  Path  Analysis 


N’PRO.I  Numb*-r  of  Proje<-ts  To  He  .Scheduled 

NNODF,  Number  of  Nod*-s  ( Activities)  To  Be  .Schediil*-d 

\AR(j  Number  of  .-\res  iPrecedenc*-  R*-lationships) 

NDUMMY  Number  of  Dummv  .Activities  lO-durationI 


*ln  ihe  tlchnilioM''  that  Inllttn.  an  altrmpl  ha*>  Imth  In  itifnlifA  j*aram«*lfr>  lhal  have  Itccn  imtialls  He*wcri!te‘t!  1»\ 

rescanher'*  ol  ihr  <“on'itraiiUMl-rr**niircf.  prniccl  wfhctiulinti  TId*m*  an*  imiiralrti  |i>  ihr  aulht»r*>s  nam:*  ft»llnwin>:  the 

of  ihc  jiaranictcr  rcfcrfiicctl.  In  sornr  inslanc«*«>.  ihf  paramp|**r  a'*  m ihi*-  paper  mav  nol  l»e  a*»  itrifdnallv  HeHcrilted 
l>\  the  author. 
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Of  those  parameters  identitied  aliove,  \ arianet  in  Aetivity  Duration  (V  A-I)l'Kl  is  likelv  to  have 
an  effect  on  the  performan<'e  of  the  SIO  lieurislir'.  nhieh  is  an  optimal  rule  (under  a set  of  restrictive 
conditions  I for  the  one-machine  seipiencing  problem  id  the  joh  shop.  This  (larameter  should  also  allect 
the  performance  of  other  rules  which  are  based  in  part  upon  ai-tivity  duration. 

The  last  three  (larameters  i f DKNSn'^  . XDKNSITV  . and  (.OMPI-EXI  l'Yi  measure  the  inter- 
connectedness of  a network,  and  thereby  influence  when  (in  terms  ol  network  lo>:icl  an  activity  can 
he  scheduled. 

2.  Time  and  Network  Kas<‘d  Parameters  (lomputed  Siilisequent  to  (iritiral  Path  Analysis 

i!(!l’l.  Isum  of  the  (iritical  Path  i.enfrths 


y cr. 


\(iPI.  Average  ( Critical  I’ath  I.enfith 
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M.AXiiPI.  Maxitmim  (Iritical  Path  l ength 
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XSI.ACK 


TOTSI.A(’K-R 
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Average  Total  Slack  Per  Activity 
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()(  llu'  |iaram<*lf rs  in  llii'-  s«T«in<l  ralenory.  thos*-  llial  reHect  m*'asiur»'s  of  float  or  slack 

prcscnl  in  activities  are  likely  to  aecmint  tor  a sipiilicant  portion  of  the  variation  present  in  the  per- 
formance of  the  Least  Total  f loat  heuristic.  Since  measure-  <;f  slack  do.  however,  reflect  scheduling 
Ireedom  in  the  setise  that  specific  activities  can  he  delayed  without  delaying  the  completion  of  a 
pro|cct.  this  measure  will  undouhtedly  account  for  a larize  portion  of  the  variation  in  the  hehavior 
of  the  other  setpii-ttcint;  rules.  Delay-  should  Ion  the  average)  he  less  when  usinp  le.^.  I the  .S|()  heuristic 
in  -chedulint:  a project  with  larjie  amount-  of  -lack  on  a high  prop.ortion  of  activities  than  in  scheduling 
a project  in  which  few  activitie-  possess  relatively  -mall  amounts  of  slack  or  total  float. 

This  second  category  id  measures  includes  parameters  ha.-ed  on  the  total  float  <ind  the  free  float 
present  in  project  networks.  Measures  of  free  float  were  included  because  the  measures  of  total  float 
overstate  the  amount  of  schedulitig  freedom  availahle  in  an  activity:  activity  total  slack  may  he  dupli- 
caled  lor  all  activities  in  a given  chaiti.  Lor  -u<  h activities,  the  delay  in  a preceding  activity  means  a 
loss  of  -lack  in  the  succeeding  activities.  The  above  measures  also  reflect  the  percent  of  activities 
which  possess  either  total  or  free  slack,  as  well  a-  the  amounts  possessed. 


3.  Resource  Rused  I’aranieters  (tenerally  4ium|»ulefl  .Sul»s(‘i]uenl  to  (iritiral  Path  Analysis 

l*(n'Kk  I’ercent  of  Activities  Ke(|uiriiig  Positive  Amounts  of  He-ource  k 
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I lili/.ation  of  Resource  k ( Measured  over  the  longest  critical  ()ath  length ) ( Davis) 
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\ A-CON 
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Average  Resource  Constrainedness  I sing  All  Activities  as  a Base 
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The  aliove  resource  utilization  parameters  reflect  tlie  "liglitnc's  ' of  certain  resoiircr-  t>|»es. 
Oliviously.  if  the  deinaml  lor  a (larticular  resoiiri'e  at  any  [Miint  in  time  clues  not  exceed  the  availahilit) . 
Rii.  then  this  r*-source  is  not  very  constraining  and  fevi  rt’sohition-  o|  conflicts  in  the  demand  for  this 
resource  will  havr-  to  he  made,  'ml  where  conflicts  do  ha\e  to  he  resolved,  hut  the  i|uantities  re(|uired 
ap|iroach  the  availahility  cd  a resource,  conflict  resolution  will  have  to  he  made  hut  will  he  of  little 
conse(|uence  in  terms  of  the  ultimate  duration  of  a project.  An  exam|)le  o(  this  latter  situation  wa»  given 
in  th*'  previous  section. 

Between  the  extremes  of  a large  jHcrtion  of  tlw  activities  demanding  a large  ipiantitv  of  the  avail 
ability  of  a resource  and  resources  being  available  to  schedule  all  competing  a<  tivities  without  resolu 
tion.  a given  heuristic  has  the  jiotcntial  to  effect  decisions  which  mav  hear  hcavilv  on  the  criterion 
being  evaluated.  1'his  is  because,  of  course,  the  heuristic  has  the  ahilitv  to  select  some  (possibly  unic|uel 
subset  of  the  activities  available  for  sch«-duliiig.  As  tin-  number  o|  activities  which  could  be  inchnled 
in  a given  subset  of  sr'heduleil  activitu-s  increasr-s,  and  as  the  number  o|  leasible  subsets  of  activities 
for  selection  increases,  tlie  more  potential  tlu-re  is  for  effecting  decision-  which  will  have  an  impact  on 
the  final  results.  The  resource  jiarameters  herein  termed  "( !onst  raine<lness"  and  "( ionstrainedness 
Over  Time"  are  examples  of  (piantifiahle  indices  of  jNUential  decision-making  effectiviutess.*  High 
values  of  certain  constrainedness  parameters  imply  the  jrotential  for  masking  the  intended  effectiveness 
of  heuristic  jrrocedurr-s.  .As  the  average  demand  for  a |>articular  resource  decreases,  for  example,  the 
potential  for  making  effectivr-  decisions  inerr-ases.  Several  differ*-nt  constrainedness  indice;  are 
included  in  order  to  identify  tludr  potential  effect  on  heuristir-  (rerlormance. 
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flirts  implies  onf  |o(i  nr  artivilv  is  -rhi-ifiilr-ij  anil  till  .11111-1  availalilr  |i>ti-  nia-t  In*  pn-tpiniril  nn  ?vo>  nr  innrri  arliiitn--  ii-inr: 
(hr  same  ri-snurr.'  ran  hr  nii-rniini:  al  (hr  -ann-  liinr. 
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where  the  demand  Inr  re'imree  /,  e-  lia»ed  on  an  all  earlv  ^larl  'chedule  isee 
h i>;ure  _’l. 
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Nuinl>rr  ol  rimt-  lVri<nl!«  Tli«*  IVinaiid  lor  K***.ourcf  k Exrt'cds  the  availahility  of 
Ke><ource  A (where  the  demand  i^  based  on  an  all  early  start  sehedule) 
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Demand  for  Resource  A (where  the  demand  is  based  on  an  all  early  start 
schedule  I 
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Fifiure  2 is  a resource  profile  of'  the  demaii'ls  lor  the  one  resource  involved  in  Network  2 of  Fifiure  1 
l)ased  upon  ear  ii  activity  Ireinfi  scheuuied  at  its  • ritical  path  analysis  determined  early  start  time.  As 
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shown  in  the  nonresource  constrained  version  ol  this  prohlem.  the  peak  demand  for  resources  occurs 
in  time  period  seven  at  16  units  and  reaches  a low  demand  of  three  units  in  time  periods  17  and  18. 

.‘\n  imposed  limit  of  six  units  on  the  i|uantity  of  resource  availahh*  will  extend  the  duration  of  this  proj- 
ect heyond  tl;e  18  time  periods  indicated  hy  its  critical  path  len^h.  These  latter  resource  based  param- 
eters provide  an  indication  of  the  conflicts  which  will  develop  hecause  of  the  limitation  on  resources. 

These  measures  assess  both  the  numher  of  lime  periods  in  which  resources  are  underulili/.ed  or  over- 
utilized. and  the  amounts  of  overutilization  and  underutilization  based  on  an  all  early  start  schedule. 

Knowing:  in  advance,  for  example,  that  then-  are  very  lew  lime  periods  in  which  the  demand  for  re- 
sources exceeds  the  availability,  one  mifilil  hi-  tempted  to  employ  conventional  critical  path  procedures 
and  resolve  the  conHicIs  as  they  develop  in  the  life  of  the  project  and  not  plan  the  seiiiienciiif:  of  ai  - 
tivities  with  any  formal  heuristic  procedure. 

\ FORTR.AN  profiram  was  written  to  calculate  the  parameters  in  each  of  the  three  cat»  fiories 
above.  I’hi-  values  obtained  then  served  as  independent  variahles  in  a regression  model  to  predict 
heuristic  perlbrirance.  Stepdown  multiple  ri-(iression  was  Used  to  analyze  the  schedulint:  results,  and 
independent  variahles  with  a net  regression  coefficient  significant  iMesll  at  the  95  percent  level  re- 
mained in  the  regression  e(|uations  developed. 

V.  MUI.TIPLE  RE(;RESSI0N  RESI  ETS  FOR  PREDI(,TIN(;  HEl  RI.STIC 

PERFORMANCE  | 

Sixty  multiprojeci  scheduling  prohlems  were  computer  generated  using  network,  lime,  and 
resource  parameters  from  |12|  to  construct  each  network.  Project  sets  generated  ccmsisl  of  6 to  10 
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projects  each,  and  each  project  C(nisists  of  20  to  40  activities.  Thirteen  different  resource  categories 
were  involved,  and  each  activity  demanded  fixed,  positive  amounts  of  resources  from  as  many  as  l.f 
resource  categories.  This  generated  data  is  thus  representative  of  that  found  in  practice. 

Three  criterion  functions  are  investigated  for  this  multii»roject  data:  (1)  minimize  the  sum  of 
the  delays  beyond  the  critical  path  length  for  all  projects:  l2l  minimize  the  sum  of  the  total  weighted 
delays  of  the  projects,  where  the  weights  are  determined  hy  the  size  of  the  project  measured  hy  total 
resource-unit  requirements  (total  work  content  I for  project  completion;  and  (.f)  minimize  the  [lercent 
increase  in  cri'ical  path  duration,  where  the  groU|>  of  projects  are  conjoined  Ity  dummy  nodes  to  form 
one  project.  This  latter  criterion  is  e(|uivalent  to  minimizing  makespan.  or  the  tim»'  rei|uired  to  com- 
plete all  jobs  (projectsl.  In  a typi'  .(  multiprojeet  organization,  the  firm  larely  accepts  a group  of  projects, 
finishes  this  group,  then  accept-  another  group,  finishes  it.  etc.  Rather,  projects  are  entering  and  being 
completed  in  tlie  organization  coterminately;  still  others  are  in  |)rogress.  For  completeness,  however, 
and  to  contrast  our  results  in  minimizing  project  makesfian  with  those  results  reported  in  job  shop 
scheduling  research  and  elsewhere,  the  criteria  of  minimizing  projei't  makespan  is  included  in  the 
analysis. 

Table  4 presents  some  summary  statistics  for  the  60  (iroject  sets  generated,  and  I'able  .S  gives 
information  on  a factor  analysis  performed  to  condiine  the  project  variables  into  independent  lactors. 
The  six  factors  retained  account  for  71  per<-ent  of  the  information  accounted  for  by  all  independent 
variables.  Tables  6.  7.  and  8 then  give  the  results  of  the  regression  analysis  for  the  objective  functions 
minimize  Total  Project  Delays.  Total  eight*‘d  Project  Delays,  and  Percent  Increase  In  I'he  l.ongest 
Critical  Path,  respectively. 


Tabi.E  4.  Summary  Statistics  h'or  Sample  Independent  I 'ariahles 
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Twelve  independent  variables  given  in  section  I\  were  omitted  from  the  regression  equations  in 
Tables  6,  7,  and  8 because  of  the  multicolinearity  which  would  have  otherwise  been  present  (several 
of  the  independent  variables  are  (lartially  derived  from  others).  Variables  eliminated  because  of  zero- 
order  correlations  exceeding  0.90  with  anvither  variable  left  in  the  model  include;  NPROJ,  .NNODE. 
NARC,  XDI  R,  T-DENSITY.  YCPl..  MAXCPL.  XSI.ACK.  PDENSITY-T.  PDENSITY-F.  MINCON- 
TM.  and  MAXCON-  AFl.. 

In  order  to  not  bias  the  objective  functions  of  minimizing  Total  Project  Delays  and  Total  Weighted 
Project  Delays,  a record  was  kept  of  the  delays  and  weighted  delays  in  the  projects  as  of  a specific 
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Table  3. 


Factor  Loadings  Exceeding  0.70  In.  Absolute  Value  — I'arimax  Rotation  * 
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time  in  each  schedule  span  (usually  about  73  percent  o(  the  length),  and  the  objective  functions  were 
evaluated  as  of  this  time.  This  removed  bias  which  would  have  otherwise  been  present  as  projects 
entered  the  completion  phase  and  the  simultaneous  demands  for  resources  declined. 

Tables  6.  7.  and  8 reveal  some  rather  interesting  relationships  for  the  data  examined.  For  example, 
specific  independent  variables  remain  in  (stepdown  regression)  each  regression  equation  with  differing 
solution  techniques  (heuristics),  indicating  that  a statistical  relationship  does  exist  between  problem 
structures  and  the  method  employed  to  solve  each  problem.  Note  al.so  that  some  of  the  project  param- 
eters—especially  those  assessing  relationships  between  resource  requirements  and  resource  avail- 
abilities—are  significant  in  a majority  of  the  regression  equations,  indicating  their  importance  in 
scheduling  proje"^  activity  for  all  solution  orocedures.  .Additionally,  from  a comparison  of  Tables  6.  7, 
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Results  for  Total  Project  Delays 
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Tabi.F.  8.  \lullii>lf  Hcfiressiiin  Results  Jor 

|6()  hyiMithelical  mulli|inijc(  t 
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and  8.  wliicli  of  the  parameters  remain  in  solution  is  a ftinetion  of  iht' ohjective  funetion  heiny:  evaluated, 
indieatinir  that  the  choice  of  a sehedulinfi  rule  is  also  depenilent  upon  the  liesired  result  of  seherltilinf; 
effort. 

A comparison  of  the  cohimns  “Standanl  Deviation"  and  "!Siandaril  lirror  of  Kstimate  .Ahout  Ke- 
tiression"  and  an  examination  of  the  R^  valties  provide  some  indication  of  tfie  efficacy  of Httr  proeetfiire. 
In  general,  no  less  than  82  percent  of  the  variahility  in  results  obtainetl  tisinji  any  hetiristie  proeetfure 
can  he  explained  hy  the  regression  models  tieveloped. 

■An  experiment  to  further  assess  the  efficacy  of  these  regression  models  mighl  consist  of  the  f ollow  - 
ing. f or  each  of  the  ohjective  functions  evaluated,  rank  tin*  InMiristics  on  the  low«‘st  mean  valu»‘  attained, 
the  next  lowest  mean  valur-  attained.  et<'.  This  gives  an  order  in  which  to  select  a heuristic  procedure 
for  solving  prohlems.  not  considering  uni(|ue  problem  structures.  Alternatively,  predict  (using  the 
models  developedi  the  heuristic  rule  which  will  likely  produce  the  lowest  value  of  the  objective  func- 
tion. the  next  lowest  value,  etc.  for  sfiecijic  problems.  Then.  one.  two.  three.  . . . of  the  heuristic  rules 
can  be  employed  to  schedule  project  activity,  and  the  following  iiue.vtion  addressed:  hat  is  the 

expected  improvement  (if  any)  in  using  the  rules  ranked  by  the  regression  etpiations  on  each  problem 
as  opposed  to  selecting  the  rules  on  the  basis  of  lowest  average  results  obtained'.''" 

Figure  3 presents  data  in  this  regard.  For  example,  if  a heuristic  is  selected  to  minimi/.e  project 
delays  on  the  basis  of  lowest  mean  value  obtained  in  solving  these  multiproject  scheduling  problems 
(in  this  case,  the  SIO  heuristic),  the  amount  of  total  project  delay  will  be  16  percent  above  what  could 
be  obtained  by  solving  thes**  same  pndilems  with  all  rules  and  then  selecting  the  schedule  with  the 
minimum  amount  of  total  delay.  If  instead,  each  problem  is  solved  using  the  heuristic  projectetl  best 
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re!*iMjrr«‘  usage  i Summary  statistics  and  regressij>n  results 
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iin  inciease  in  total  project  delays,  then  the  solution  on  the  average  will  he  only  8 percent  above  what 
could  he  obtained  hy  using  «//  heuristic  procedures.  Using  only  one  heuristic  secjuencing  rule  to  solve 
a given  problem  (which  might  usually  be  the  case),  use  of  the  regression  equations  results  in  an  expected 
improvement  of  8 percent  in  this  objective  function  value  ( 16-8  p-ercent).  Naturally,  as  the  number  of 
solution  techniciues  examined  increases,  the  relative  advantage  of  using  the  regression  models  developed 
decreases. 

The  use  of  the  regression  equations  for  minimizing  Percent  Increase  in  Longest  Critical  Path 
Duratioti  generally  does  not  produce  a substantial  improvement  over  using  the  rules  based  on  lowest 
average  value  obtained,  as  indicated  in  I'igure  3.  The  appropriateness  of  this  particular  objective  func- 
tion is  certainly  open  to  <juestion.  however,  as  discussed  earlier.  .And  results  in  minimizing  Total 
Weighted  Project  Delays  using  the  regression  models  are  encouraging,  although  the  diJerences  in 
results  obtained  are  not  as  great  as  in  the  minimization  of  Total  Project  Delays. 

In  order  to  further  test  the  approach  reported,  relevant  project  scheduling  literature  was  reviewed 
to  gather  project  data  from  othc sources  for  analysis.  The  most  extensive  set  of  data  obtained  consists 
of  83  single  project  scheduling  problems  generated  by  Davis  [2]  for  use  in  testing  his  bounded  enumera- 
tion algorithm.  Davis  used  resource  and  network  parameters  nearly  identical  t(»  those  used  hy  Johnson 
[9]  is  his  investigation  of  the  single  constraine<l-resource.  project  scheduling  problem.  Johnson  based 
^his  network  generation  routines  on  experience  gained  from  two  sources.  He  examined  more  than  50 
CPM  networks  submitted  for  processing  at  one  computing  center.  He  also  examined  networks  that  have 
appeared  elsewhere  in  various  case  studies.  Briefly,  each  project  consists  of  either  22  or  27  activities 
(nodes),  and  each  activity  can  recjuire  fixed  amounts  of  three  scarce  resources.  Pertinent  statistics  for 
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many  of  the  independent  varialiles  pjven  in  section  I\  are  presented  in  I'alde  9 for  the  problems, 
A factor  analysis  performed  to  combine  the  independent  variables  into  fai-tors  is  given  in  Table  10. 
Because  single  project  data  are  examined,  only  the  objective  of  minimizing  the  percent  increase  in 
critical  path  duration  is  assessed.  As  noted  by  Davis  [4).  this  criteria  also  minimizes  the  delay  in  the 
(•((inpletion  of  the  single  project. 
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I'akI.K  Summary  Statistics  Far  Sample  Irideuendent  Variahles 
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rile  repression  results  oliiained  usinp  this  siiiple  project  data  are  piven  in  Table  1 1.  Seseral  o|  the 
independent  variables  lound  in  the  previous  repres'-ion  results  do  not  appear  in  this  table  her'ause  of  the 
hipher  number  of  zero-order  correlations  exceedinp  0/X).  I wo  independent  variables.  PDKNSIIY  F 
and  Ml.NCON  I'M.  not  present  in  the  previous  repression  e<|uations.  remained  in  lor  this  data. 

Despite  the  preat  dissimilarity  of  data  tv|>es  examined  isinple  vs.  multiple  projects;  three  vs.  l.i 
resourt'c  catepories;  etc.),  similar  tendencies  can  he  noted  in  the  results  reported  in  Table  8 and  Table 
1 1.  h’or  example,  there  is  a tendency  lor  the  heuristio  l.'FK  and  IT“I  to  perform  the  best  on  the  criteria 
examined,  and  for  the  heuristics  MJP  and  SIO  to  perform  relatively  worse  than  a rule  which  resedves 
resource  conflicts  at  random  in  both  sets  of  data.  Many  of  the  inde|»endent  variables  which  remained 
in  the  repression  e(|uatioiis  for  the  previous  results  are  also  present  lor  the  Davis  data  even  thouph 
several  variables  were  eliminated  from  the  candidate  variables  list  because  oi  problems  with  multi- 
odinearity  which  wcnild  have  otherwise  developed.  .Additionally,  parameters  based  on  resource  utili/.a 
tion  are  sjpnilicant  in  every  repression  eipiation  for  both  sets  ol  data;  the  minimum  resource  ulili/ation 
parameter  is  sipnifieant  in  the  Davis  problems;  the  maximum  resource  utilization  parameter  is  sipnili 
cant  for  the  multiprojeci  data. 

Kven  the  above  discrepancy  in  the  MINT  ril.  vs.  MAXI  Til.  parameter  beinp  sipnflicant  in  the 
repression  e(]uations  lor  these  two  important  classes  id  problems  ran  be  resolved.  The  difference  in 
values  of  minimum  and  maximum  resource  utilization  lor  the  Davis  sinple  iiroject  data  laveraped  across 
all  priddems)  is  U.90—  0.78  - 0. 12;  for  the  multiproject  schedulinp  data  it  is  1.67  — 0. 1 1 - I ..'i6.  a much 
larper  difference.  Moreover,  the  parameter  M.AXTTIl.  is  hiphly  correlated  with  M.A.X('()\  I'M  in  the 
Davis  data  {p  — 0.%).  so  that  the  M.AXTTIl.  (larameter  was  not  permitted  to  enter  as  an  inde|iendent 
variable.  The  MAXCON-TM  parameter  is  sjpnificant  at  the  0.9.S  level  in  six  of  the  eipht  eipiations 
reported. 

I'he/^-  values  for  each  repression  equation  for  this  second  proup  of  data  ranpe  Irom  a low  of0.8.'f  to 
a hip'e  of  0.93.  indicatinp  apain  that  a statistical  relationship  does  exist  between  the  parameters  included 
and  the  idijective  of  schedulinp  effort. 

VI,  AN  IMPROVED  PROfjRAM  FOR  PROJECT  SCHEDlMNi; 

(dven  the  improvements  reported  with  the  use  of  prediction  equations  described,  advantape  can 
be  pained  by  constructinp  a propram  incorporatinp  all  heuristir  procedures.  Then,  heuristic  ruleisi 
can  be  selected  from  those  available  based  upon  unique  problem  characteristics  for  solvinp  individual 
problems.  Figure  4 is  a simplified  flow  chart  of  such  a program.  Fipure  .'f  provides  some  indication  of 
the  advantages  of  such  an  approach  over  a similar  program  which  incorporates  only  one  solution  tech- 
nique and  in  which  no  attempt  is  made  to  determine  beforehand  tin-  solution  procedure  to  use. 

VII.  SUMMARY  AND  CONCLUSIONS 

.Scheduling  iirobletns  often  exhibit  unique  characteristics  which  make  them  more  amenable  to 
solution  with  a particular  procedure.  The  advantages  of  analyzing  problem  structure  and  then  choosing 
a techni(]ue  for  sidvinp  it  can  be  significant.  For  the  data  examined  herein,  they  are  as  indicated  in 
Fipure  .'f. 

For  certain  other  problems,  the  choice  of  a schedulinp  techniipie  (rule)  is  relatively  unimportant  — 
nearly  all  will  produce  schedules  with  the  same  or  nearly  the  same  objective  function  value.  These 
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I'lu-  rfurr-'inii  rf>ull>  llii^  pn>jf<i  data  arr  fiivftt  in  I aide  I 1.  .''rvcral  n(  ihr 

md«-|ifn(j(‘til  Nanal)l«*>  Imind  in  tin-  prfviinis  r«‘^r<*»'i<>n  n'Milli-  dn  nut  appear  in  tlii>  lalilc  lifcauM*  id  ihf 
higher  ninnlirr  id  /.criiiirdfr  (cirrrlaliiin'  *-x«*-«'dinj!  0.40.  1 wn  indepfndcnt  \ariald»*».  I’DK.NSIT^  K 
and  Ml\(d)\  I \1.  nut  pn-M'iil  in  llic  piruini-  n‘tir«->>iiiii  »-()ijaiiiins.  rt-maini'd  in  lur  lfii>  data. 

Dc'pili-  tin-  f:rcal  di-i-imilaritN  id  data  typ«--  <‘\aininrd  i>«inj:lc  v«.  niultiplt'  pniiiTt-;  tlir«-f  Id 
if'iiiirri-  ratr>:iiric'.  l•t'■.  l.  similar  l*•nd(•n(■i*•'  ran  In-  nnt«-d  in  tin-  rr-iilt-  ri'piirtn;  in  I aide  8 and  I aide 
I I.  l-iir  cxainidf.  tln-rr  l^  a l»•ndl■n(•\  Inr  thr  ln-uri>ti<  ' l.l'K  and  I.K’I  tn  pfrlinni  t(v  In-  t mi  tin-  i ritcna 
|•xanlint■d.  and  Im  tin-  lu-uri-tii  ' M.ll*  and  SIO  tn  p<-Hi>rm  n-latiw-U  wnr-i-  than  a ruii-  uliii  h ri->"id\f' 
n--miii'i'  I'linllirt'  at  randmn  in  Imtli  oct'  id  data.  Manx  id  tin-  indi-pcndcnt  varialdc-  uliirh  i('main(*d 
m till-  ^■^:r«‘■•^illn  fi|iiatiiiii-  Inr  llic  prcximi-  r«--ult>  arc  aUn  pr«--»-nt  Im  tin-  l)a\i»  data  t-vn  llinui:li 
'I'W'ial  xarialdr-  wm-  idiininatrd  Imni  tin-  landidatr  variatdc«  li»t  In  rati'i'  id  priddmii'  viith  multi 
ridini-aritx  vslnrli  Miiiild  liaxi-  ntlii'i  M I'l-  d«-x<-lnp<-d.  \d<iitinnalls . |iaramHi‘r'  lia'i-d  mi  rc-nuri  r iitili/a 
!imi  an-  •ijiniln  ant  in  r\rr\  ri-|:ri-"inn  fi|natinn  Inr  Imtli  'i-t'  id  nala;  tin-  inininiiim  Tl•-nllr^<•  ntili/atimi 
|iaramcU-r  ^iirnitn  ant  in  tin-  l)a\i»  prn|d<-in-:  tin-  niaxiniutn  rn'iiiircr  utili/atimi  |iaramcti-r  is  M^niii 
l ant  Inr  'In’  inulti|irn|i’i  i data. 

F..r:i  tin-  aliiiM-  di'rri’(iani  \ in  the  MINI  I'll  \s  MA\l  I'll  parann-ti-r  lirinj;  'i^niln  ant  in  tin- 
((•jrrrssimi  l■l]uatinns  Inr  lln  sc  iwn  inipnrtani  rlassc^  nt  pridili’iii'  ran  hr  rrsnUrd.  I hr  diUrrrncr  iii 
\ allies  III  minimum  and  maximum  rrsnurre  utili/atimi  Im  the  I)ax i-  'inj;le  pmiei  l data  la'  erajii’d  ai-rns.. 
all  prnldeins  I i>  0,90  (1.78  (I  1 J:  Inr  the  miiltiprnieet  seliediilin);  data  it  |s  167  0.11  !.i6.amueh 

larmier  dilierenee.  Miiren\ri.  the  (laraiiiriei  MAXI  III.  is  hi):liK  enrrelated  vxitli  MA'.t.ON  IM  in  the 
l>a\is  data  Ip  = 0.96i.  sn  that  the  M A\l  I'll.  |iarameter  was  imt  permitted  In  nitri  as  an  independeiil 
\aiialde.  I'he  MA.XiiON  IM  parameter  is  si^nifieant  at  the  O.O.d  lexel  in  sjx  d ihe  rit:!):  ei|uatimis 
li’tliirted. 

I lieK  ' X allies  ini  eai'h  re^iressinn  e(|uatimi  Inr  this  scrmid  ^imup  id  data  laiifie  Irmn  a Inxx  n|  0.8d  tn 
a Inch  id  (I.O.d.  indieatintt  ajiain  that  a statistii  al  relatinnship  dues  exist  hetvxeeii  the  parameters  im  hided 
and  the  nhieetixe  id  sehedlilinj:  ellnrt. 

VI.  AN  IMPROVKI)  PR<H.KA!V1  KOR  PROJECT  SCHEDl  I.INC 

(•ixeii  the  imprnxements  lelnirted  xxith  ihe  use  id  preilietinn  eiiualimis  deserihed,  adxantaj:e  ran 
he  gained  hx  rmisti iirtini;  a (irruram  mrmpnratiii}:  nil  heuristii  [imerdures.  Then,  heiiristie  rulei'i 
ran  he  selected  Irmn  ihnse  axailahle  hased  iipnn  iinii|ur  prnhiem  rhararleiis|ies  |nr  snixmji  inilixidiial 
prnhleiiis.  Hjmre  4 is  a simplihed  ilnxx  rharl  n(  such  a prntiram.  Ki^ure  .4  prnxides  snme  indiealimi  id 
the  adxanta(:rs  id  such  an  appmarh  nxer  a similar  prn^ram  xxhir’h  inenrpnrales  nnix  mie  sidiitimi  Irrh- 
nii|ue  and  in  xxhieh  nn  attempt  is  made  In  determine  h<dnrehand  the  snlulinii  (imredure  In  use. 

VII.  SI  MAIARX  AM)  CONCl.l  SIONS 

.''(■hediiliiif;  prnhlenis  nlleii  rxhihil  iiiiii|iie  ehararteri~Iir s vnIhi  Ii  make  them  iiinrr  anienahle  In 
snhitimi  xxilh  a partirular  prnredure  The  ailxantap-s  nt  aiialxv.int:  prnhiem  siriietiiie  and  t/ieri  rhnnsinj: 
a technique  I'm  snlxiiir  it  e.iii  he  si^nihraiit.  Knr  the  data  examined  herein,  thex  are  as  indiealed  m 
Kit:iire  .'I. 

F III  rerlain  idher  prnhlenis.  the  rliniee  id  a sehediilin>:  terhnique  (rule  i is  relatixeix  uiiimpnrtant  — 
nearly  all  xxill  prndiire  schedules  xxith  ihe  same  nr  nearix  the  same  nhjeelixe  liinetinn  xalue.  These 
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prolileins  ):eM<'rally  cnnsist  of  projfcts  in  which  ihc  initial  olistruclinn  as  (ieterinincd  by  an  all  early 
-tart  schediile  is  low.  Several  indices  ol  "resource  consfainedni-ss"  were  also  described  whieli  can 
contribute  to  the  masking  of  heuristic  performance. 

Subsequent  to  the  computation  of  the  regression  models  reported,  attempts  were  made  using 
step-wise  I "gression  and  multiple  correlation  to  determine  chaiacteristics  of  problems  which  would  tend 
to  mask  the  effectiveness  o the  heuristic  procedures  employed.  In  general,  it  was  found  that  greater 
•lifferences  in  heuristic  pe,  formanee  an-  likely  to  o<-eur  for  those  projects  or  those  project  sets  in  which: 

’ I initial  obstruction  is  l..gh;  2 I projects  possess  relatively  large  amounts  of  and  occurrences  of  free 
float:  and  ,'ll  certain  resource  consirainedness  measures  are  low.  Naturally,  for  example,  as  the  amount 
of  obstruction  in  a problem  decreases,  few  resolutions  of  sequencing  conflicts  have  to  be  made,  and  the 
results  obUMiied  with  different  methods  are  siniilar. 

rile  following  guidelines  are  useful  for  sehwting  a proceilure  to  use  in  scheduling  multiproject 
activity  to  minimi/e  total  proj«‘ci  delays:  The  .“shortest  Imminent  Operation  heuristic  generally  performs 
the  best,  particularly  when  the  variance  in  activity  duration  is  small  (but  is  not  /.ero!l.  Further,  projects 
possessing  a small  proportion  of  activities  of  rather  long  duration  are  not  effectively  scheduled  with 
this  rule.  This  is  because,  of  course,  the  larger  duration  activities  have  a tendency  to  be  postponed  too 
long,  resulting  in  greater  total  project  delays.  (These  results  agree  with  those  reported  elsewhere  for 
the  job  shop.  I Working  on  as  many  jobs  (activities  I at  a time  as  is  possible  can  be  effective  in  reducing 
total  project  delays  when  the  SK)  rule  has  been  discarded  because  of  high  variability  in  activity  dura- 
tion. although  this  rule  can  be  extremely  dysfunctional  when  trying  to  minimize  other  measures  of 
heuristic  performance.  And  in  general,  the  I.east  Total  Float  and  the  l.ate  Finish  Time  heuristics  are 
comparativvdy  effective  on  those  uroblems  in  which  the  variability  in  activity  duration  and  the  average 
free  slack  per  activity  is  high.  We  would  expect  these  latter  two  setjuencing  rules  to  exhibit  similar 
performance,  since  for  each  activity  they  differ  from  one  another  only  by  activity  duration. 

The  results  reported  aUo  demonstrate  the  necessity  of  determining  beforehand  the  desired  results 
of  scheduling  effort.  In  minimizing  project  makespan.  for  exanqile.  a combination  of  the  I.east  Total 
Float  or  the  l.ate  Finish  'l  ime  rules  resulted  in  44  out  of  60  minimum  makespan  schedules  for  the 
multiproject  data,  and  in  6.i  out  of  83  minimum  makespan  schedules  for  the  single  project  data.  There 
was  additionally  little  discernible  difference  in  results  reported  using  these  two  procedures  to  minimize 
project  makespan  for  multiproject  activity.  By  contrast,  the  .“shortest  Imminent  Operation  heuristic 
protiuced  only  18  out  of  60  schedules  resulting  in  minimum  total  project  delays,  and  the  variation  in 
results  obtained  w ith  different  rules  was  much  more  significant  in  a majority  of  the  p 'oblems  examined. 
Hence,  the  determination  of  the  most  likely  rule  to  schedule  project  activity  effectively  is  not  only  a 
function  of  problem  characteristics,  but  is  also  a function  of  tbe  desired  result-',  ol  -.cheduling  effort. 
For  minimizing  project  makespan.  one  is  fairly  "safe"  in  using  the  I.east  Total  Float  or  the  l.ate  f'inish 
Time  rule;  for  other  I'riteria  of  scheduling,  regression  analysis  becomes  an  effective  tool  in  selecting 
the  appropriate  seiiuencing  discipline  to  employ. 

Perhaps  an  even  greater  use  to  be  gained  from  the  results  reported  in  this  paper  is  in  the  area  of 
training  project  scliedulers  and  program  managers.  I'sing  an  interactive  system,  for  example,  program 
managers  can  examine  project  and  resource  characteristics  and  through  projections  of  their  own  and 
the  actual  results  of  scheduling,  learn  which  sequencing  rules  are  likely  to  be  effective  under  various 
problem  characteristics.  This  man/machine  interaction  should  also  enhance  our  ability  to  learn  more 
of  the  role  hetween  problem  structure  and  heuristic  performance  in  scheduling  multiproject  activity. 
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SCHEDllLINC;  TO  MINIMIZE  THE  WEIGHTED  SUM  OF 
COMPLETION  TIMES  WITH  SECONDARY  CRITERIA 


Hii  iiani  lUmis 

titsfnihnn  \utitnifit  I mu‘r\it\ 
(.tinlu-nti.  lusttnlm 


AliSIKAri 

\ o‘sull  nt  Sniitfi  in  ihi'«  hMirnal  |.i|.  i>n  tlu'  i)>»f  ■>!  sc(oniiiii> 

rritt-ria  in  '•rhrJulin;:  pioUlnii''.  i-^  olitiwn  to  hr  in<  orfri  I ami  a < oijtitrr  rx.nnpir  |irr'>rntril. 

firck  aixl  Kolirrt'*  |2|  ''U;:^r''lr«{  that  tlirir  papri  vsouM  hr  rvtt'iiiirii  ill  (hr  '«ainr  Ha\ 

NmitliV  al^uritlini  v\as  \ nt-M  algorithm  ;:i\rii  that  ron\«-i^r>>  to  a loral  optiimini  for  [>oth 
prn|)lrins. 

1.  HA<:M;ROlfM) 

'I'lic  [>n>lil(‘iii  Ilf  iiiiniiiii/.iii^  ihi'  sum  ■>(  VM-i^litrij  roiniilrtiun  timi-s  sulijcct  in  a sfciuKlury  con- 
siraini  lias  imi;;  hern  coiisiilcrcil  In  lie  similar  In  miiiimi/iii^  llic  siim  nl  i nmiilrlinii  limns  sulijcii  In 
a cniislraint.  Smilli  |.'<|  l‘J56  iin'si'iilcd  an  al^mritlim  (iir  ihn  /i  jnl).  I -inacliinn  casn  v\litTi-  lie  miiiimi/.nd 
the  wci|;lilcd  cnmplclinii  limns  sulijnni  In  llin  <’nn>lrainl  llial  all  jnlis  vinrn  nnmpinind  li\  llinir  dun 
datns.  Hnnnntly  Hnnk  and  Hnlinris  |2|  prnsnnli'd  an  alfinrillmi  inr  minimizini;  ihn  sum  ni'  nninpintinn 
limns  sulijnni  In  nnt  innrnasin};  llin  maximum  lardinnss  nalnulaind  li\  itin  dun  daln  snipinnnn.  Thny 
nlaimnd  llial  llinir  rnsull  rniild  lin  nxlnmlnd  In  llin  prnlilnm  n(  wnifihtnd  nnmpli'linn  limns  in  a inannnr 
similar  I • Smilli's  al“nrillim.  Sunli  is  mil  ilm  nasn  siiicn  Sinilh's  aljznrillim  did  mil  lim)  ihn  n)iiimum 
snipinilcn. 

I sill"  llin  iinlalinii  nf  (iniiway.  Maxvinli  and  Miller  1 1 j.  Ini  jnli  i have  iirnnnss  limn  /i,.  dun  daln  (/,. 
wni^ilil  (I,  and  nninplnlinii  limn  r,.  1 lie  [irnlilnm  undnr  nmisiiinralinii  is  In  (ind  a -nipinnnn  In 

1 1 1 miiiiiiiizn  V (i,r, 

I i 
i 

(2)  slllijnct  In  V /!,  — </,  i 7 Inr  I = I , 2 ri 

j I 

Knr  T —0  in  i2l  llm  prnlilnm  i>-  llm  nnn  mn-idnrnd  |i\  Sinilli  |.'l|  an  I Ini  T=  maximum  lardinnss  llin 
prnlilnm  is  llin  nnn  nl  Hnnk  and  Hnlinris  |2|. 

2.  A COIMKK  FAAMIM.K  TO  SMITH’S  Al  OOKITHM 

riin  mnllind  "ivnil  liv  Smilli  In  snivn  ill  sulijnnI  In  l2l  v%  il  ll  0 is  as  Inlinvs  s:  "11  all  jnlis  nail  lin 
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completed  l>y  their  due  dales,  an  order  whieli  iiiiniinizes  tlu‘  wei{ihted  sum  may  i>e  ohtained.  This  order 
has  its  last  joh  one  witli  the  larnesl  value  of />(/«,•  from  those  with  due  dale  as  larpe  as  the  total  proeessint; 
lime  of  all  johs.” 

(Consider  the  followiii}:  example: 


ioU 

1 

2 

3 

I 

/'■  ! 

4 

' \ 

3 

2 

dj 

8 

i 

1 16 

«, 

1 

4 

3 

4 

3/4 

\ 

1 2/3 

I sinfi  Smith's  al^'orilhm.  joh  2 wtudd  he  plaeed  last,  sinee  joh  2 and  3 both  have  due  dales  ^treater 
llian  or  eipial  to  the  total  process  time  and  3/4  >2/3.  (ionsideriiif’  the  remainiiif:  two  johs,  a{iain  both 

joh  1 and  3 may  he  last  and  4 >2/3.  Therefore  the  optimum  se(|Uence  is  3.  I,  2 with  ^ o,Ci=48. 

i . 1 

However,  the  se((uenee  2,  1,3  also  has  all  j4>hs  completed  by  their  due  date  anti  V Uir,  = 46.  Hence 

i I 

-Stnith's  altiorithm  does  not  give  the  correct  sequence. 

When  c(msid(  ring  joh  A to  he  placed  last  it  is  necessary  to  check  that  the  residting  secpience  satis- 
fies (2).  Hence  a more  precise  statement  of  Smith’s  algorithm  would  he  as  follows: 

Al.dORITH.M  1:  (a)  Order  the  jol»s  in  the  order  of  increasing  due  dales.  It  is  assumed  that  all 
johs  are  on  time  by  this  schedule. 

(h)  I’lace  joh  A last  where 

— > — for  all  ( su«’h  tlial  the  resulting  sequence  will  satisfy  (2). 

Ui 


(c)  Keduce  ri  by  1 and  return  to  (ht  until  all  johs  have  been  se(pienced  by  this  method. 

3.  LOCAL  OI»TIlVIMVI 

1 wo  setpiences  .S'  and  .S'  are  said  to  he  adja<-eiit  if  one  can  he  formed  from  the  other  by  a single 
interchange  ol  two  johs.  A sequence  i.s  feasible  if  and  only  if  it  satisfies  (2). 

>1 

DEFINITION:  A se(]uence  is  a lotal  optimum  for  I j)  subject  to  (2)  if  ^ iiin  is  less  than  or  eipial 

i ] 

to  the  sum  of  weighted  completion  times  of  all  feasible  adjacent  sequences. 

In  order  to  check  lor  a local  optimum  a metlnxl  of  comparing  two  adjacent  se(iuences  will  now  he 
develo[)ed. 

Let  .S  he  a secpience  with  the  johs  nund>er<’d  1.2 n and  let  .S'  he  an  adjai’eni  secpience  having 

johs  A and  /,  interchanged.  Vi  ithoul  loss  of  generality  we  can  assuiTie  that  joh  I.  appears  after  job  A in 
the  secpience 
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For  i k — \ and  for  i ^ L, 

a,r,  = a'-rl. 

For  i=  k,  k + \ , . . L — \, 

f',  = ^1+  (pi  -/>*)• 

Therefore 

/>  n I 

^ (iti'i  - ^ r/,'c'  = Uki  k + «//•;.  - «*<■/  — iiiCk  T (/n  -pi)  ^ a,. 

i = I i I I A-  - I 

'file  followiiifi  leniina  follows  directly  from  the  definition  of  a local  optitmim  and  eijiiation  (3). 
1T]MMA  1 : A seriiiencc  S is  a local  optimum  if  and  otdy  if  for  ail  feasible  set|uences  ilifferint;  from 
■S’  by  bavin}' jobs  L and  k intercbaiif'ed  with  k < L the  expression 

k 

(4)  «;(•/  + (ikCk  — (iki'i  — a,Ck  + (/»;.  - pi)  2 iti  ^ 0. 

/=/..  I 

For  the  special  cas<-  where  all  the  weifihts  are  one  then  equation  (3)  becomes 

II  n 

('ll  ^ Cj-  V C,  = {pk  - Pi  ){L-k). 

it  i t 

Note  that  for  the  unwei}'bted  case  the  difference  between  two  adjacent  se(]uences  is  only  a function  of 
the  two  terms  bein;:  intercban'ied  and  their  distance  apart.  Lemma  1 would  have  an  ei|uivalent  form 
for  the  unweif'bted  case  where  e(|uation  (5)  would  he  substituted  for  etpiation  (4).  The  proof  that 
Algorithm  1 converfies  to  a local  optimum  (for  the  unweighted  case)  is  strai}>ht  forward  and  in  fart  was 
done  correctly  by  .Smith  as  he  essentially  developed  ei)uation  (3). 

For  the  weifihtcd  case  the  difference  between  adjacent  se<)uences  is  a function  of  the  jidrs  between 
the  two  interchaii}'eil  jobs.  In  the  papers  by  both  Smith  and  Heck  and  Roberts  a very  si»ecial  case  of 
e(|uation  (3)  was  use<l.  Vi  hen  l,  = k f-  1 equation  (3)  fu-comes  the  lollowiii};. 

« II 

y aiCi  - V = iikCk  (Ik  . ,Ck  ■ i — ua''*  . ,—iik  . |C/.  + (Pk  ~ Pk  • i )<U  . i 

f I f 1 

A-  I k I 

= (Ik  ^ Pi  + (ikPi.  + (Ik  . I V p,  + (Ik  . ,pk  + (Ik  ■ iPk  ■ I 
f I It 

k l k i 

- (Ik  y i>, — iikPk —<ik  \ y p, — III.  ■ \Pk  Ilk  ■ \Pk  — (Ik  ■ ipk  - 1 

it  It 

n n 

{(■>)  y II, r,  - y II, n = Uk . ,Pk  - iikPk  ■ 1. 

f I II 
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E(|uution  (6)  is  the  test  used  in  sirp  (b)  of  Alfiorillmi  1. 

LEMMA  2;  Alfiorithni  1 (Smith I ronvfr}i«'s  to  a constraini-d  stationary  sc(|Ufncc  ,S  havin';  tlie 

N 

property  that  ^ o/r,  for  .S  is  less  tlian  or  erpial  t<i  the  sum  of  weifrhied  completion  times  lor  the  sid)set 

i = I 

of  feasible  adjacent  seiiuenees  formed  by  interehanpnji  only  |)airs  of  jobs  that  are  adjacent  in  .S', 

PROOF:  Let  the  jobs  in  .S’  be  numbered  in  aseeiulinj;  order,  1,2 n.  .Assume  the  Lemma  is 

false.  Then  there  exists  .S'  a feasible  se()uence  adjacent  to  .S  v\ith 


V (I,r,  — V n,'c'  > 0. 

i I (1 

and  S'  and  S'  difler  oidy  in  the  / and  k + I st  position.  By  lb) 


in  in  ■ I 

— > 

Ilk  <n  , I 


When  Algorithm  1 was  choosing  the  joh  for  the  / + 1 position  job  k was  rcji'cted  and  later  placed  in 
position  k.  Since  S'  is  also  feasible,  job  k must  have  been  eligible  to  go  in  the  ^ + 1 si  positioti.  By  step 
(b)of  Algorithm  I 


Pk  . I /H 

«*  . I Ilk 

whicii  contradicts  the  result  of  the  assumption. 

The  counter  example  presented  shows  that  considering  only  inici changes  belwcen  jobs  that  arc 
adjacent  in  a se(|uence  is  not  a sufhci»-nt  <-ondition  for  a smiucncc  to  satisly  Lcmm.i  I.  The  following 
algorithm  uses  e(|uation  (2)  to  generate  a lor'al  optimum. 

.\L(»()RITHM  2:  1.  Schedule  the  jobs  in  in<T<-asing  order  ol  due  date.  (It  is  assumed  that  all 
jobs  ar«-  completed  by  their  du«'  date.  If  such  is  not  the  case  a solution  to  ( 1 ) subject  to  (2)  with  T ci|ual 
to  the  maximum  tardiness  is  straight  forward.) 


2.  For  k=n  — \,  n—2,  . . ..  I, find  the  first  value  ol  A satisfying  the  followitig  three  conditions. 
1 7 ) ^ ^ ~ 

i I 

iH)  If  [III  > Pa,  then  c , + p„  — — </j  s=  T for  ;’=  /.  + 1 . ^ + 2 n — 1 

n 


iikCk+ii«rn  — ii,,i'k  — iik<'n+{pk—lhi)  2 (;i"(). 

I A - 1 

If  such  a k is  found,  interchange  job  k and  n.  Reset  ii  to  its  initial  value  if  neci'ss.iry  and  rclurn  to  the 
beginning  of  step  2.  If  no  k is  found  satisfying  (7),  (8)  ami  (9)  reduce  n by  I.  For  ;i  2 return  to  the  be- 
ginning of  step  2.  For  11=  1 the  optimum  s«'<|Uenc«-  is  tin-  current  one. 


SCMKIH’I.IM;  to  minimizk  compittion  timks 


129 


THKOKEM  1:  Algorithm  2 fonverfics  to  a local  optimum. 

PROOF:  Fvcry  lime  step  two  is  succcsslul  the  sum  of  the  wei}:hte(i  completion  times  is  reduced. 
Since  tl'iis  can  oidy  liappen  a finite  nutnlier  of  times  the  alttorilhm  terminates.  Conditions  (7)  and  (8) 
determine  wliich  term  in  tlu>  sequence  can  he  interchaii}>ed  witli  joh  n and  equation  (9)  is  c(|uivalent 
to  liaving  tlie  right  liand  side  of  c(|uation  (3)  greater  than  zen».  Step  2,  will  only  terminate  after  n has 

passed  (7),  (8)  and  (9|  for  all  values  of  n from  1,2 n.  Hem-e  hy  Lemma  1 the  stationary  point  found 

liy  Algorithm  2 is  a local  optimum. 

4.  CONCLUSION 

Algorithm  2 on  the  counter  example  would  first  find  the  stationary  point  that  Smith's  method 
stoppe<l  at,  and  then  moves  dire<  lly  to  the  global  optimum.  It  is  not  always  the  case  that  the  local 
(q)limum  found  hy  .Algorithm  2 is  the  global  optimum. 

Consider  the  following  example: 


job 

1 1 1 
I I 

2 

3 

l>i 

4 

3 

i 

6 

(It 

8 

13 

14 

(It 

1 

4 

i 9 

Algorithm  2 would  generate  a local  (qitimum  seipience  1.3.  2 with  V (iiCi  = 146.  The  global  optimum 

I I 

;i 

is  2.  I.  3 with  ^ (uri=  136.  .At  present  there  is  no  simple  way  of  finding  a global  optimum  for  permu- 


tation se(|uences. 
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ABSTRACT 


A ( la>s  of  (‘xpon«*Mlial  typ^  distributions  with  special  exponential  parameters  is  defined. 
It  is  assumed  that  tin*  exponential  parameters  vary  according  to  some  (known)  pr(d>nl)ility 
law.  It  has  lieen  shown  in  this  paper  that  the  eompouinl  distrihulion  can  l>e  easily  represented 
in  form  involving  moment  generating  function  of  the  mixing  distribution.  Tin*  results  obtained 
in  (his  pap<*r  provide  an  <‘ffi<'ient  and  simple  method  of  obtaining  compound  failure  lime 
distribution  with  known  mixing  distributions  (uniform,  exponential,  gamma). 


0.  INTROUI  CTION 


Oiif  inctliod  (amoii}'  oiIuts)  of  constnu-liiig  a nevv  disiribution  is  to  use  the  known  parainelrie 
lorm  of  a distriliution  and  allow  one  (<ir  some)  of  the  parameters  to  vary  ai  eordin{{  to  a specified  proh- 
aliility  law.  The  new  distrihution  is  called  a compound  distribution. 

The  theory  of  compoitnd  distrihutions  is  well  known  and  fre(|uently  used  in  various  seientirie 
disciplines.  In  particular,  it  seems  that  this  theory  has  useful  applications  in  (industrial)  reliability  and 
(medical)  survivorship  analysis.  The  probability  of  survivinfi  u|)  to  a certain  time  might  be  a function 
not  oidy  (tf  the  age  of  an  individual,  hut  also  of  other  factors  (|)arameters).  ^2,  . . .,  ^j).  which 

may  not.  in  fact,  be  constants  but  vary  fr<un  individual  to  indivi<iual  and  with  time  as  well.  For  example, 
in  survivorship  analysis  explanatory  variables  such  as  age.  bh'od  pressure,  blood  count,  lipid  levels, 
etc.,  etc.  are  sometimes  (diserved.  \V  hen  they  are  not  observed,  their  effects  are  nonetheless  still 
present;  the  {'s  may  be  regarded  as  representing  ibese  effects.  In  the  population,  we  then  have  a 
mixture  (or  compound)  of  distributions  with  ('s  as  mixing  variables. 

It  seems  to  be  useful  to  have  a simple  and  rapid  method  of  obtaining  a compound  distribution  — and 
this  is  the  purpose  of  this  article. 

(a)  It  is  shown  in  this  paper  that  for  a certain  <dass  of  parental  distributions,  the  compound 
distribution  can  be  obtained  from  the  moment  generating  function  of  the  mixing  distribution.  This  is 
another  api>lication  of  the  mgf.  besides  that  of  obtaining  the  moments. 

(b)  Of  some  interest  is  the  situation  where  the  mgf  is  of  txi'onential  form.  In  this  case  the  com- 
|)ound  distribution  can  be  factorized;  the  components  due  to  i)arental  and  mixing  distributions  can 
be  predicted. 

The  pa|)er  is  not  concerned  with  the  use  of  the  comi>ound  distrihutions  in  statistical  inference. 


*Tliis  wttrk  wais  Mipjmrtrd  l)>  I ,S.  National  Hrart  an«l  l.ung  lnstitul<‘  <onlract  NIH-NHI.I-71-224.^  from  the  National 
l>wtitiit<‘s  of  Health. 
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The  examples  given  in  section  4 are  mostly  not  new  and  are  only  used  as  illustrations. 

To  make  the  paper  selfcontained,  a few  definitions  will  be  introduced  in  the  next  section. 


1.  DISTRIBUTIO^S  OF  EXPONENTIAL  TYPE 

For  the  purpose  of  this  paper  we  find  it  convenient  to  define  a special  class  of  exponential  type 
distributions  in  the  following  way. 

DEFINITION  1:  The  distribution  of  a random  variable  (rv)  .Y  is  of  simple  exponential  type  if  its 
cumulative  distribution  function  (cdf).  F\{x),  is  of  the  form 


(1.1) 


F.\{x)  =f.v(x;  Tj;  Of)  = 


[ 1 —exp  [— T7«(x;  a)] 


for  X ill 
for  X > ill. 


where  t)(>0)  is  a “special”  parameter,  which  we  will  call  the  exponential  parameter.  a=  (oi «, ) 

are  “ordinary”  parameters,  and  u(x[  a)  is  an  increasing  function  of  i with 


(1.2) 


u(i;of)^0  as  i—*  ill, 

u(i;of)— ♦ac  asi— 


We  extend  the  definition  to  the  multiparameter  case. 

DEF'INITION  2:  The  distribution  of  a random  variabh'  X if  of  ^-parameter  exponential  type  if 
its  cumulative  distribution  function.  Fxix).  is  of  the  form 


(1.3) 


Fx(x)-  >-\{x-.  Tj;  a)- 


0 

1 — exp 


-^7),Hf(i;  a,) 


for  i « ill 


for  i > .vii 


and  Tji  > 0,  i = 1 , 2,  . . .,  A.  Here  i}=  (tji,  . . ..  17/,)  are  exponential  parameters  and  «,(i;  cn)  are 
increasing  functions  of  x such  that 


(1.4) 


Ui{x:  oti)  — ► 0 as  i —*  in, 

Uj(i:  tti)  ^ as  i -♦  X 


for  (=1,2 A. 

Most  lifetime  distributions  used  in  biology  and  reliability  belong  to  the  exponential  type  as  defined 
in  this  article,  f’or  example,  the  Weihull  distribution  with  cdf 

/■,v(i)  = 1 — exp  [ — T7(i  — ^)"],  a ^ TJ  > 0,  (r  X) 

is  of  exponential  type  with  u{x:  «)=  (i— f)“. 

In  this  article  we  will  discuss  compound  distributions  of  A when  the  parental  distribution  i>  of 
exponential  type  and  the  exponential  parameters,  tj tj/,-  vary. 
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2.  COMPOUND  DISTRIBUTIONS  OF  A WIIKN  »»  IS  THE  MIXING  PARAMETER 

l.fl  F\(\)  lie  (IcfitK'cl  as  ill  (1.1).  I'lic  luncliiin 

l2.1i  /V{.V  • « 1 ~ I ~ \ ‘ 1 = ) 

is  called  a suri  ii  <il  fuiirtion.  (In  relialiilily  theory  il  is  also  called  relinhility  f'linction). 
(ainsider  tj  as  a rv.  with  edl 


i2.2)  >'}  = /\(.v;  y)  = P>i(y). 

satislyin'i  the  eoiiditions 

/'.,(  > ) -►()  as  V -►  Vn  I 

(2.3l  0 ' V)  ^ 1 Vn  • > ■ X ( 

/’>i(  v)  — * 1 as  > ^ ) . 

(Here  y=  (y, y,„)  are  parameters  of  the  distribution  (2.2)1. 

We  will  call  t \ i\)  the  inireiital  (lisiril/iilioii.  and  P>)(.v)  the  mixiiif:  lor  ntmixnindin^:)  distribution. 

We  assume  that  the  moment  f;eneratin}j  funetion  (iniif).  of  the  mixiii”  distrihiition  (2.2) 

exists.  Since  17  > 0.  all  moments  about  zero  of  the  distribution  are  non-ncfiative.  and  is 

a noiideereasinti  fiiiietion  <d  .v. 

Let  6'a  (a  ; y.  «)  = 6’  v (,x ) denote  (he  edf  id  the  eoin|>ound  disirihniion.  /-'i  (a;  t;.  tt)  P>d  v;  y ) . .ind 
let  = 1— he  its  survival  funetion. 

THKOREM  1:  If  the  |iarental  distribution  id' the  rv  is  of  simple  exponential  type  is  defined  in 
(1.1)  and  the  exponential  parameter  tj  has  a distrihution  (2.2)  with  mfil.  l/>i(5).  then  the  ''oinpoimd 
distrihiition  id'  \.  (i\{.x),  is 


(2.4) 


(.r ) = 6'v  (a:  y.  «)  = 


I" 

1 1 — W(—  //(a:  a)  I 


for  A * (<i 
lor  I .III. 


Proof  is  immediate.  The  survival  fum'lion  is 


(2..S) 

Put 


Gi(a) 


/■ 


exp  [ — Ht »:  a ) \ )i/P>,(>  ). 


(2.6) 


s = — H ( a:  a ) . 


rims  the  integral  in  (2.5)  heeoines 


(2  7) 


Gi  I » ) = e'S 

J Wt* 


'■''(/Pi) i\)  = Mnis)  = .Ml) [ - « ( A : « I 


prmided  that  Ui/[  — i((  »;  a )]  exists  for  « ■ t«. 
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We  find  intereslini'  to  consider  mixing  distributions  of  t)  for  which  nigf  has  the  form 

(2.8) 

where  6=(8i 8m)  are  parameters.  Vie  now  denote  the  parental  distribution  (1.1)  by  F\  ;>i(.r)  to 

emphasize  that  it  is  a conditional  distribution  of  A’  given  tj,  and  rj  can  he  considered  as  a random 
variable. 

Corollary  1:  H the  parental  distribution  F\:iiix)  is  given  by  (1.1)  and  the  mixing  di-itribution 
Filly:  y,  6)  has  the  mgf  of  the  form  (2.8).  then  the  compound  edf  of  ,Y,  C\{x).  is  of  the  inrm 

(2.9)  (>.\lx)  — 1 — 4[  —uix:  a):  6]  [1  — /•',v;v(a)]. 


.Notii'c  that  F\:y{.\)  in  (2.9)  has  (he  same  original  form  as  (1.1)  with  rj  replaced  by  y. 
PKOOK:  riie  survival  fimctioii.  G\{x ),  is,  from  (2.8) 

f.’.v(a)  =/l[  — u(x;  a):  8]  exp  [ — yu(jr;  «)] 

(2.10) 

= /([  -u(.r;  a i:  S]Fx:y{x), 

and  so 

6'v(t)  = 1 u(v:  a);  8]A;v(x) 

- 1 - //(a;  a);  8]  1 1 ; v(a)]. 

It  is  also  easy  to  see  tliat  the  following  result  is  true. 

COKOLLARA  2:  If  the  mgf  of  thi-  m.xoig  Jisuiuuiioo  is  of  the  form 


(2.11)  A/,,(.s)  = «(s;  6)fl-e>’].  y>0 

then  the  compound  cdl  <d  A.  (/\{,»r).  is 

(2. 12)  C v(a)  = 1 — B[—  uix:  a):  6]  • Fx:>(x). 

3.  COMPOUND  DI.STKIBUHONN  01  A WKII  MULTIDIMENSIONAL  MIXINfi 
OISTItIBUTIONS 

Theorem  1 can  be  extended  to  the  multij)arameter  case  (1.3). 

THKC^'-  i 2:  Kor  a parental  distribution.  Fx(x),  of  /-parameter  exi)onential  type  defined  in 

(1..J).  v'r.jt,  ij=  iq tja)  are  the  mixing  i>aramctcrs  with  joint  distribution  F-qiy:  y)  which 

the  mgf  .Wt}(5i sa  ).  exists,  the  compound  distribution  of  A.  6',v(a).  is  of  the  form 

(3.1)  f-\(v)=  1 -/Wijf— «,(.a;  tti) — UA(A:tHA)] 

Proof  is  similar  to  that  for  Theorem  1 
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We  now  consider  some  special  cases  of  the  joint  mixing  distributions. 
First  we  notice,  that  (1.3)  can  be  written  as 


(3.2) 


i=  I 


[1  -F.v;.),(x)], 


X « Xn 
X > x„ 


where 


i3.3)  F.v:  ij(x)  = 1 -exii  [ -T),u,(x;  Of)].  i=l k 

is  of  simple  exponential  type.  In  case  of  a lifetime  distribution  of  a certain  system  with  k components. 

the  parameters  tji tj*  may  be  associated  with  various  properties  (e.g..  resistance,  strength. 

elasticity,  etc.  of  the  material).  Keeping  t)i rji  fixed,  each  f’Aiiilx)  in  l3.3)  may  represent  the 

lifetime  distribution  of  the  ith  component;  thus  F\:  A (x)  in  (3.2)  would  correspond  to  the  minimum  life- 
time distribution  for  the  system,  or  it  represents  distribution  of  first  failure  of  the  system. 

In  life  testing,  the  assumption  that  vp 171.  are  fixed  im|>lies  that  the  units  in  the  test  sample 

were  obtained  from  a homogeneous  population.  This  may  not  always  be  true,  in  particular  when  an 
industrial  ()rocess  undergoes  some  seasonal  fluctuations  or  the  units  are  biological  organisms  for  which 

initial  conditions  (e.g..  genetic  makeup)  cannot  he  controlled.  We  may  then  assume  that  tji tj* 

are  independent  randtim  variables  with  joint  cdf 

(3.4)  /^,(  v)=  M /%(>  ). 

I I 

If  .W<)  (ii)  is  the  nigf  of  7),.  then  the  joint  mgf.  W,(si,  . . ..SA).is 

A 

(3.D)  :V/q(5| 5a  ) = II  .t/»)j(5t). 

I I 


We  have  the  following  theorem. 

THEOREM  3;  If  Fx-’iix)  is  as  defined  in  (3.2)  and  the  mixing  distribution.  P^(y)  is  as  defined  in 
(3.4).  then  the  compound  distribution  of -Y,  fM*x).  is  of  the  form 

(3.6)  Cm  (x)  = 1 - { 1 - [-  U,(x;  a,)]} . 

I I 

Here 

(3.7)  1 — .WiJ— u,(x:  a,)]  =(7,(x) 
is  the  compound  distribution 

F\  n (x){),/%,  (y). 

I’roof  of  Theorem  3 is  straightforward.  Extensions  of  (Corollaries  1 and  2 are  also  straightforward. 


{ 

I 

i 

I 

r 
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4.  ILU  STRATIONS  WITH  l*AREM  AI.  VtElRl  l.L  DISTRIBl  TIO> 

To  illustrate  the  teetmi(|iies.  we  use  some  e\aiii|>les  m which  the  parental  distrihution  is  Weihull. 
Most  o(  the  resiiltint'.  eompoiiml  ilistr.fuitions  are  not  new  and  have  heen  derived  hy  other  authors. 

EXAMPLE  1;  Weihull  (tj)  (>amina.  The  results  iu  this  example  have  alread\  heen  ohtained  1)\ 
Dubey  (1%8).  The  results  are  used  to  demonstrate  the  use  id'  tlie  moment  fieneratint;  function.  Let 

(4.1)  >/(  «)— exp  I — 7/(  » ^l") 


be  the  Weihull  survival  function,  .'suppose  that  tj  has  t;amnia  distrihution  with  pdf 


(4.2) 


' y ' ^ 


' Y- 


The  nifif  of  ^amma  distrihution  (4.2)  is 


(4.3)  l/.,(.s)= 

(/3-.V)'’ 

The  compound  survival  function,  (.((x).  is  obtained  from  i2.1Dl.  We  have  nix:  i.  ol  ( x if  I '. 
ti'' 

A is:  8 ) = — — — T . I‘ut  .s  - — ( X - t ) ’.  I'hus.  from  (2. 10( 

1/3-5)" 


Note  that  f»\(,x)  is  the  product  of  two  survival  functions.  Lhe  first  factor 

!,j.if-7T^f  ' ''  ‘ ■" 

is  the  Hun  / i/ic  \ll  survival  function.  [ 1 ) as  was  pointed  out  hv  Duhev  il*)6Hi.  I he  second  factor 

'4. 6)  exp  ( — y(  X — t I ' ) . X ■^.  (X  0.  y • (I  ; 

; 

is  ariain  a Weihull  survival  function  with  parameter  v instead  cd  o''icinal  tj.  < 

For  y = 0.  the  second  factor  in  l4.4l  is  equal  to  1.  and  it  riqireseuts  a Hun  I vpe  XII  distrihution 
(Duhey  I 1%8]  ).  ' 

For  (X  = 1 . the  parental  distriliution  i4.ll  is  e\|>ouential  truncated  from  below  at  x S.  and  i4.fi 
takes  the  form 


fM(  X I 


8"  _ 

I (/3  - f ) -X  xl"' 


M J 


A 


(4.7) 


I 
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EXAMPLE  2:  Distribution  of  the  least  value  of  k independent  Weibull  variables  compounded  by 
k independent  exponential  distributions. 

Let 


(4.8) 


EA:i(x)=exp  [- ^ Tji(x-f)"] 


for  X > ^.  a > 0,  T)i  > 0.  i — 1 . 2,  . . .,  A. 


! .ct  the  pdf  of  T}i  be 


(4.9) 


/)T),(  v)  = )8e y>'yi.  jS  > 0 


for  1=1,2 A. 

Then  the  compound  survival  funciion  of  (4.8)  by  (4.9)  is.  from  Theorem  2 


(4.10) 


Notice  that  puttinn  A = ft  and  ^ Vi  = y.  (4.10)  becomes  identical  with  (4.4).  This  is  not  surprising,  since 

I I 

/. 

Tj  = y T),  is  the  sum  of  ex(tontntial  variables  with  the  same  )3.  and  so  it  has  a gamma  distribution.  The 

i I 

truncation  points.  yi yk.  contribute  only  to  the  second  term  in  (4.10). 


EXAMPLE  .3:  Weibull  (tj)  A I nif<^rm.  This  distribution  was  considered  by  Harris  and  Singpur- 
walla  (1968). 

Let  be  a parental  distribution,  and  su|)pose  that  pdf  of  tj  is  uniform  with  pdf 


(4.11) 


/Oi(.v)  = 


1/c  for  n < y < a + c. 


1 0 elsewhere. 


The  mgf  of  (4.11)  can  be  written  in  the  following  form 


(4.12) 


■V/.d-O  = — e'-MC'-l). 

cs 


Then  from  Corollaries  1 and  2.  we  have 


(4.13) 


(mI.x)  = 


1 


r • /i(x.  a) 


F\,„(x)  ■ Fx.r(x). 


138 


R.  C.  EI.ANDT  JOHNSON 


When  Fx,v(x)  is  a Weibull  distribution  of  form  (4.1)  we  have,  from  (4.13) 


(4.14) 


T~Kto  {1  -exp  [-c(x-f)“]}. 


An  alternative  form  of  (4.14)  is 


(4.15) 


, 2 exp  [-(o  + r/2)  (jr-f )"]  . , ,r  , 

“ TiwP “■ 


Other  mixing  distributions  which  can  l)c  considered  but  exponential,  gamma,  and  unifortn  dis- 
tributions are  those  which  are  most  likely  to  be  applicable  to  real  situations. 
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THE  NORMAL  APPROXIMATION  TO  THE  MULTINOMIAL  WITH  AN 
INCREASING  NUMBER  OF  CLASSES* 


l.ionel  Weiss 
Cornell  / nirersit\ 


ABSTRACT 

For  a fixed  iiunilie*'  <d  elasses  and  llie  number  of  trials  increasing,  the  approach  of  the 
multinomial  cumulative  distribution  function  to  a normal  < iimulative  distribution  function 
is  familiar.  In  this  paper  we  allow  the  niimlMT  <»f  classes  to  increase  as  the  number  of  trials 
increases,  and  show  that  under  certain  (drcumstances  the  probabilities  assigned  to  arbitrary 
t regions  by  tlx*  imiliinomial  distribution  are  all  <*lose  (<i  the  probabilities  assigned  by  the 

distribution  of  "rounded  (»fT"  normal  random  variables.  As  the  number  of  trials  increaser. 
the  atiidiinl  rminded  olT  appruaclies  zero.  The  resiill  < an  he  used  to  study  the  asymptotii 
I distrihuliori  of  liiiK'tioiis  of  inultiiioniial  random  variables. 


I 


t 


1.  NOTATION  AND  ASSlIMPTIONS 

F'or  each  n.  X,{n).  X:{n) V*(„i{«)  have  a joint  multinontial  distribution,  with  parameters 

n.  /),  (n) ri ) where  /;((«)>  0 for  /=  1 kin), 

1.1  II I l;t  II I 

^ />,(«)  = I . Xiin)  = n. 

it  It 


We  make  the  followint:  assumptions: 

(1.1)  min  [1  — p,(n ) ] > A for  some  A X): 

I ‘ i'  k\  n] 

(1.2)  min  n/^(n)  approaclies  infinity  as  n increases: 

I * / • hi  n I 
l.itii 

(1.3)  ^ [n/ti(n)]  ' - approaches  zero  as  « increases; 

i I 

(1.4)  k(n)  [npAtHi(n)]  ' - a|)proachcs  zero  as  n increases. 

Note  that  we  do  not  recniire  that  /,(n)  approach  infinity  as  n increases,  hut  our  assumptions  allow 
this  to  occur. 

’This  resean  h wa.s  sU|i|iorle<i  lo  Ihe  National  :’'rienee  Koiindniion  iiniler  (iranis  til’  31430X2  and  MI’S  74-24270. 


I 
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Define  l^iCn)  as  [np((»0]  ''‘^[A',(n)  — npi(n)]  for  i = 1,  . . ..  ^(n).  so  that 

ki  II ) 

^ Vpj(n)  yj(n)  = 0. 

For  typographical  simplicity,  from  now  on  we  write  F,  instead  of  Fi(n),  Pi  instead  ofp,(n),A'j  instead 
of^i(ra),  and  also  do  not  explicitly  exhibit  the  dependence  on  ri  of  certain  other  (luantities  to  he  defined 
below. 

Denote  P[F,  = yj;  i=l,  . . A{n)  — 1]  by  h„[y i).  h„(y yum  i)  is  given 

as  follows.  If  yi,  . . .,  yk(n)  i are  such  that  npi+  Vnp,  y is  a non-negative  integer  for  ; = 1 

h(n)  — 1,  and 

U II)  1 

^ [npi+ V^  y,]  S n. 


logA„(yi,  . . .,  yA-(„)  _ I ) — log  « !+  ^ [nPi+V^^>i]  logp,— ^ log  ( [npi  + V^,y,j !} 


where  yk{n)  is  given  by  the  identity 


X V^>i  = 0. 


For  other  values  of  (y, yu„,  ,).  h„{y yum  i)  = 0. 

Now  suppose  Z|,  . . .,Zun)-i  have  the  following  joint  normal  probability  density  function: 

/ J , U ( II)  I I 2 . /,  ( II  ) 

(-)  lx....)  '•e»p{-2 

where  z^n)  is  given  by  the  identity 


2 VpiZi  = 0. 


Define  the  random  variables  Z Zk{n)  as  the  following  function.s  of  Z] Zum  |.  For  i = 

1,  . . .,  k(n)  — ],Zi  is  the  closest  value  to  Z,- which  makes  np,+  V npiZ, an  integer  (positive,  negative, 
or  zero).  If  there  are  two  possible  values  for  Zi,  use  the  sntaller  one.  Zuiu  is  given  by  the  identity 

ki  n ) 

2 v^  z,=o. 
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Denote  P[Z/  = 2,;  ( = 1 A(n)  - 1]  by  g„(2i,  . . iA(ni  \)-  Kn(z^ 2a(„)  - 1)  is  given  as 

follows.  If  are  such  that  n/i,  -f  2/  is  an  integer  for  (=  1.  . . A(n)  — 1,  then 

2a,  „)  I ) is  equal  to 


1 i|-i 

''  2tt 


^ — ' [pa(„i]  ' - I ■ • • I 


. llZk  i n ) I 


,1 


where  the  region  H„(z Z1.01)  1)  is  the  set  of  points  (2 i/.(,o  1)  sueh  that 


1 1 , , 

=S2,S2,-f- -=  lor;=l, 

2 \nfi,  2 Vnp, 


. k{n)  — 


i.ifl  in  the  integrand,  zu„)  is  given  hy  the  identity 


^ V'p,2,  = 0. 


f!i,(zt 2/, 00  1)  is  zero  for  other  values  <d' 2 1. 

For  any  event  E,  E denotes  its  negation.  <I>(a  ) denotes  the  standard  normal  t umulative  distribution 
fiiiK  tion.  Below  we  will  use  the  following  elementary  inequalities: 


(1.,‘j)  For  any  event.s  E E»,,  P(Ei  H . . . D E,„)  = 1 ~ ^ E(E, ) . 

I 

(If,)  For  any  .r  > 0,  1 — tl>(x)  < -. 

2.  THE  ASYMl’TOTiC  EQUIVALENCE  OF  h„  and  g„. 

For  any  measurable  region  S„  in  (A(n)  )-dimenstional  spaee.  let  EhjS„)  denote  the  proba- 
bility assigned  to  S„  hy  h„.  and  let  E,„(.S„)  le  the  probability  assigned  to  S„  by  ff„.  We  will  prove 
the  following: 

THFORKM:  lim  |E/,„(,S„)  — ) | =0.  for  any  sequence  {S,,}.  where  S„  is  an  arbitrary 
measurable  region  in  ik{n)  — I )-ditnensional  space. 

Before  proving  the  theorem,  v.e  not-e  the  following  application  of  the  result.  Suppose  //„(  Vi 

1)  is  a function  of  A(n)  — 1 \ariables.  Under  our  assumptions,  the  asymptotic  distribution  of 

H„(Y Fai„)  i)  IS  exactly  tht*  satne  as  the  asymptotic  ilistribution  of  . . .,  Za(,o  1). 

Since  we  can  write 


z,=z,+— 

2 Vnp, 


where  |W,i  S 1, 


'HI*!'  ’.'. 


142  I..  wRiss 

for  a wide  variety  of  functions  H„  the  asymptotic  distribution  of  Za(„>  i)  will  he  the 

same  as  the  asymptotic  distribution  of  H„{Z\,  . . Z*(,o  i).  Examples  are  given  in  section  3. 

PROOF  OF’  THEOREM.  The  theorem  will  he  proved  if  we  can  show  that 

hft{Z  I , . . Z I ) 

converges  stochastically  to  one  as  n increases  |2|.  which  we  proceed  to  do. 

First  we  show  that 


lim  P 

« - X 


h„(Z,,  . 


*k{n) 


g»{Z z 


A(il) 


>0 


= 1. 


It  easily  varified  that  E{Zi)=Q,(ry  = l—p,.  for  j=l,  . . .,  k{n),  cov  (Z,.  Z, ) = - for 

i ^ j,  i,j=  1,  . . .,  k(n),  where  Za(„>  is  dehned  hy  the  identity 


kUl) 

2 V^,Z,  = 0. 

#=  1 

Define  a,  as  the  event  {-1/2  < npi+  Wnpi  Zi]  for  /=  1 k(n).  The  « vent 

(fi  H ( Z I > . . . , Z /.  ( H ) - I ) ^ 

Pn(Z I , . . Za(h)  I ) 


is  the  same  as  { f1  Of},  and  therefore,  using  (1.5), 
(=1 


ht,(Z),  . . .,  Zaoii  1 ) 
.gniZ, Z,,,„, 


A I II I 

S l-2^(n.)- 

i*  1 


1/2 -fnp,  \ ' 

y/npi{\-p,)  / 


using  (1.6).  Using  assumptions  (1.2)  and  (1.3),  we  find 


»/2+npi  \ ■ 

“ I Vnp,(l  -p()  / 


A(«) 

approaches  zero  as  n increases,  and  thus  P{  H Oj)  approaches  one  as  n increases,  (»r 

t=l 


lim 

n-  * 


h » {Z I 


l) 


>0 


>k{n)  I j 


= 1. 
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From  the  result  of  the  preceding  paragraph,  with  proiiahilily  approaching  one  as  n increases. 


log 


hiAZ \ , . . . , Z * 1,1 1 I ) 


a,AZ,. 


Zu 


is  equal  to  the  sum  of  the  following  expressions: 


12.1) 


log  n! 


(2.21 


Mil) 


^ (np,+  Vri//,Z,]  log  /I, 


(2.31 


“ X {["Pi^  Vrip,/,]!} 


(2.4) 


(2..')) 


1/2  log 


(2.h) 


— log 


II 

«,!/ 


exp 


I 


Stilling  s (orniuld  slalt*s  tiuil  for  jiny  [Hjsilivc  intrjz**r  ///, 


, w ( ) 

w — rn  -h . 

rn 


where  |(,)(m)|'^  1.  ,\pplying  the  formula  to  (2. 1 1.  we  write  (2.1)  as 

^log27r-(n+i  )|og„-„  + ^. 


We  apply  Stirling's  formula  lo  (2.3).  and  write  log  (np,+ 


'nihZ,)  as 


log  n + log  i>,  + log  ( I + --r-L-  ) 
V \ n,>,  / 


For  any  r > 0.  define  the  event  j3Ac)  as 


144 


L.  WEISS 


1- 


for  t=  1 k(n). 


I lie  event  (ii(c)  is  implied  l>y  the  event  Vilr)  defined  as  { — cn;>i+  1/2  S V np,  Z,  S rnp,  — 1/2}.  and 


/'IYiI'’)]  = 1 -‘l>  c 


npi 


\ -p,  2 Vnpii  1 

f 


id— Pi)/  V ’1--Pi  2 \npi(\—pi)  ' 


= 2{l-d>(eJ^ --j—  ) 

I \ Vl-p,  2 Vnp,(l-Pi)  / 


S 2 


nPi 1 

1-p,  2\npi(]-pi] 


)' 


sinfl  it  lo'iows  I rntn  assumptions  ( I . I )-( 1.4)  that 


kim 
i I 

ap|)n)aolies  zero  as  n increast's,  which  implies  that 

A(/i) 


appniaehes  zero  us  n increases,  wliieli  in  turn  implies  that 


kin) 

P[  n /3.<r)] 

1=  I 


approac  hes  one  as  ri  increases.  'I  his  last  fact  implies  that  with  probahility  approaehinji  one  as  n in- 
crease's, we  can  write 


1 + 


\npi 


) 


z,  1 Zf  1 / 

Zi  V 

‘/  0,Z,  \ 

\+-T= 

V iipi  2 npi  3 ' 

\npi  / 

\ Vnp,  ' 

lor  i'=l,  . . A(/i).  where  |d(|  S 1 for  j=l,  . . .,  k{n).  Applyint:  this  expansion  to  (2.d).  we  find 

tint  with  [ifohahility  approaehin<:  one-  as  ri  increases,  we  can  write  (2.3)  as 


i;2.3i' 


/.(«) 

2 


lo*;  2^^+  II  — II  lop  n — 


kin)  _ I /.'OO  1 Coo 

-5]  '^np,Zi)  lop  Pi-- ^ lop  p,-- ^ Z’}+ A(n) 

1-1  i - I ^ j ^ I 


where  A(n)  is  etiual  to 


'inhiiln 
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ly’l  I W Y7  , I \ ■’  I 

2 1 2 n/>i  ,H  I Vn/>i  J \ Vnpi  I J 

-if  (,„„+V5;^Z,)(^^)'(l+^) 


J /.(II)  2'j  o)(npi  + Vnpi  Zi) 

2 npi+VnpiZi 


It  is  easily  shown  that  A(n)  converjies  stochastically  to  zero  as  n increases,  hy  usinfi  assumptions 
.1)-(1.4)  anil  the  followitif;  facts; 

I |w(n/i,+ Vn/i/Zi)|  S 1 and  |Wj|  ^ 1 for  j=  1 k(n). 


. Vnpi  2 


Hn)  =1. 


(c|  For  any  positive  inteizers  /.  ,s,  the  sum  .S’„(r.  s)  defined  as 


(I  ( V^)' 


converfzes  stochastically  to  zero  as  n increases.  This  is  true  because,  for  all  large  enough  n.  S„(r.  s)  = 
S„{r,  1 ) for  any  .v  greater  than  one.  E{  \Zi\'')  = Ar  < ^ for  some  finite  /4r  independent  of  a. and  therefore 

Mil)  1 

E{S,Ar.  1)}  £.4, 


and  this  last  expression  a|i|)roaches  zero  as  n increases,  by  assumption  (1.3). 
Next  wc  investigate  (2.6).  If  (zi 2n(„i  i)  is  any  point  in  R„(Zi. 


Zk„i  1 ) . we  have 


Zi  = Zi  + r — ^ — where  | ^,  | § I . for  / = 1 A (h  ) — 1 . 

2 \ npi 


I M II I 1 _ I 

, y V/»,2j  and  Zaiii)  = — 

V/n,„,  \pki 


y \piZi. 


I kin)  \ , 

Zfinn  ^kin)  ^ . 

I J 
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Then  we  can  write 


AUt)  A'(n( 


zf+A„(0.z). 


where  A„(ff,Z)  is  equal  to 


(f.Zj  Aln)-1  fff  I _ A(hI-I  _ I /kill)  I 


AiAO^Z)  \<e„(Z  Za(«)  i)  where  („(Z, Zkni)  i)  is  defined  as 


^ _]_  ^ /■(»)  I Za„„  I ^ / kin)  ^ ^ 

^npi  .■“  4«p,  \Znpkin)  \2\/npk{n) 


It  is  easily  shown  that  e„(Z|,  . . Zk(n)  i)  eonverttes  stochastically  to  zero  as  n iniTeases.  usiii” 
facts  developed  above  and  the  la<  t that  j Zkiiii  | is  hounded  with  prohahility  approachiuji  one  as  n 
increases.  Usinj;  the  law  of  the  mean  for  inlefirals.  we  can  write  (2.6)  as 


(2.6)' 


where  | d | = 1. 

Summing  (2.1)',  (2.2),  (2.3) ',  (2.4),  (2. .3).  and  (2.6) '.  we  sec  that 


loft 


fiii(Z \ , 
f<n(Zt, 


• ■ ZaoiI  I ) 
.,  Za(«  I -1  ) 


converges  stochastically  to  zero  as  n increases,  completing  the  proof  of  the  theorem. 

3.  APPLICATIONS 

For  each  n,  suppose  W,i(Ti , . . ..IK,,)  i ) is  a cptadratic  in  ) , Ykun  |.  \Xe  will  investigate 

the  asymptotic  distribution  (»f //„(  F| , . . ..  V'k,,)  i ),  under  certain  conditions. 

Suppose  4/„  is  a (k(n)  — 1 ) by  {k(n  ) — 1 ) orthogonal  matrix,  with  the  clement  in  row  / atul  column  j 
denoted  by  and  suppose 


= J fory=l A(n)-1. 

Let  Z denote  the  row  vector  (Z|.  . . .,Zkun  i),  and  define  the  row  vector  lf'=  (If', If'kiiii  i) 

by  the  equation  W = M „Z' . Define  the  row  vector  T=  (T, , ) as 
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( ff' k(ii)  I ). 

V V Pkiut  / 

Then  (Ti,  . . Tk{n)  i)  are  independent,  standard  normal  random  variables.  Define  the  vectors 
T as  the  same  functions  of  Z as  W,T  are  of  Z.  We  have 

j=i 

and  therefore 

' |m„(i,y)|  |z,-z,i 

f^t 


lk{n)  - I Ikiti  ) - 1 ^ 

^\l  1 s (Zj-Z,y^ 

j=  I j= I 


where  |fl,  | ^ 1 for  all  j.  Thus 


1 

C H » 

npj 


say.  By  assumptions  (1.2)  and  (1.3),  e„  approaches  zero  as  n increase's.  Finally . we  have 


\Ti-fA  g 


€« 


v; 


for  y = 1,  . . .,  A (n)  — 1. 


Pk{n) 


Since  Hn(Z\,  . . .,  Za(„)-i)  is  a quadratic  function  of  the  components  of  Z,  we  can  write 
H„(Z  ] , , , .^Z a(h)-  1 ) . . .,  T kt.n)  l).  where  this  latter  function  is  quadratic  in  the 

components  of  T.  Then  the  proper  orthogonal  transformation  taking  T into  F=(F,,  . . .,  Fku,)  i) 
enables  us  to  write  H„(T\,  . . .,  Tk{n)  i)  as 

A(>l)  1 
j=l 

where  {Xn(y)}  are  the  characteristic  roots  of  the  matrix  of  H„.  Aiso.  V consists  of  independent, 
standard  normal  variables,  and  it  follows  easily  that 
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ft  (II)  1 

!:\UAT n(«)-.)}=  X 

/=  I 


Variance  {//„(7’,,  . . Tu„)  ,)}=2  ^ 

j'l 

Under  mild  conditions  on  the  sequence  of  vectors  {XmO  )}.  the  asymptotic  distribution  of 


/.  < U ) 1 

H„{Tts  . . i)~  ^ Xiiiy) 


j'  I 


say,  is  standard  normal.  I.et,  us  assume  these  conditions  are  satisfied.  Define  U as  the  same  function 
of  r as  U is  of  T.  Then  H„{Z Zi.oo  i ) <’an  he  written  as 


k(  n ) I 

'2 

1-1 


By  an  argument  similar  to  that  used  above  to  hound  | fT,  — , |.  we  find 


say.  If  8„  and 


5„ 


Km  II)  1 \ 1 

2 

1= I 


both  approach  zero  as  n increases,  it  is  easily  verihed  that 


Mil)  I 

HniZi II I I ) ~ ^ X II  ( 7 ) 

Jl 


/ 1.1  III  I 

I ^1.0) 

,/  I 


differs  from  Q„  by  a cjuanlity  approa(  hing  zero  sto<  haslii  ally  as  ri  increases.  From  the  theorem  proved 
in  Section  2.  it  follows  that  the  asymptotic  distribution  of 
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■ . . 1^/.  ( ■»  I ) ~ ^ Kn(j) 




2 Y 

J*  1 


is  standard  normal. 

One  particular  quadratic  function  of  interest  is 

U n I 

2 

I = I 

used  in  tests  of  fit.  The  asymptotic  normality  of  this  function  has  been  proved  by  various  authors,  usinn 
assumptions  under  which  the  theorem  of  the  present  paper  is  not  true,  for  a recent  reference,  see  [ 1 ]. 

4.  CONCLUDING  REMARKS 

The  Theorem  of  Section  2 states  that  lim  IP/,  — Pn„{S„ ) | = 0.  It  would  be  useful  to  study  tbe 

n ^ X. 

rate  at  which  sup  |P/,„(.S’„)  — j approaches  zero  i_s  /i  increases,  where  the  supremum  is  over  all 

■'*  n 

measurable  regions  in  (A  (n ) — I )-dintensional  space.  That  is.  we  would  like  a Berry-Esseen  type  bound 
for  arbitrary  measurable  regions.  I’lie  cotnputations  ne<‘essary  to  >bve  a reasonably  tifiht  bound  are 
lengthy. 
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A MARKOV  CHAIN  VERSION  OF  THE  SECRETARY  PROBLEM 


I 


1 


1 


s < hri«>lidn  Ml.ritilil 
hultttna  t 

fHtmnanfetoti,  Intininti 


\iisira<:t 

I hi-  pa|n-r  with  (hr  >r*  rt*laf\  I'rtihlrni  whrn  n -mrianr-  an*  iiitrrMrHril  J 

-(‘i|iirntiall>  ami  iht-  tir-t  t.  nui-t  lx-  him!  Th*-  ^aliir-  «il  ihr  -m  rrlarii*-  art*  oh-i-rM-il  a-  llit*\  | 

alt-  inlt‘rMt*vtt-(j.  hut  ht‘tni t'liaiiil  >tiiK  tht  h-lrihiilmii-  itl  ihr-i-  tahit--  art*  kimtaii  h urtht-i  *j 

imirt*.  tilt*  <li-trihulmn-  <it  twt.  -ti(‘t-t*--i\t*  -t*t  rt*larit*-'  \alut*-  art*  i:i'\t*rnt*il  h\  a Markuv  (*fiam  < 

t Iptitiial  fiiniiii  piili<*it*-  htr  fiiiiit*  ti  aiul  liiiiiliiirt  ttptiriial  ptijit  it*-  a-  k ami  ti  a)>pri>arh  mlimir  1 

an*  iihtaint*il.  j 


1.  I.NTROm  CTION 

The  Secretary  I’rulilcin  lia-  lieeri  <li><*u-*>-etl  in  the  (»a>l  li\  main  aiillmr-  | 1 . Tin*  |iriililem  i- 

that  a fixed  numlier  n n(  >ecretarie>  are  inI«Mvie»i*ii  s<M|uenliallk  ami  llir*  value  id  each  i»  iilnervcd. 
where  ihia  value  rnav  either  he  a numerical  valu«*  nr  ^impl^  a relative  rankinn.  I'he  case  where  nnlv  a 
relative  ranking!  is  nliserv*‘(l  has  heen  tieated  hv  nlhers  (S.  6.  H.  9].  and  th>-  neces-arv  anal\-is  and 
even  the  results  are  nf  a (|uite  diffr-rent  nature  than  the  ea-«-  treated  here,  namelv  where  the  value  nl  a 
secutarv  is  a numerical  value  Imm  a knnwn  prnhahihty  disirihutinn.  Immediately  altei  a secretary  - 
value  is  nhserved,  a decisinti  must  he  made  tn  either  hirr-  Iwr  nr  tint,  with  the  prnvisn  that  «he  cannnt  he 
hired  latr'r  on.  The  ohjective  is  tn  till  the  I,  avaiiahle  |nlrs.  with/,  (inssihlv  (treater  than  I.  with  the  k best 
secretaries.  In  this  paper,  we  assume  the  values  nl  the  successive  secretaries  ,ire  raiidnm  variahle- 
Iroin  r different  kiinwn  distrihutiniis  such  that  tlie  successive  ilistrihutiniis  are  itnveriied  hv  a Markov 
chain  »vith  a knnwn  traiisiiinri  matrix,  'FIk*  nh)ective  i«  tn  Imd  a seipiential  [inliey  wliii  h ma\imi/es  tl.e 
expected  sum  nl  tlie  values  of  those  k secretaries  chosen  lor  the  k posiiiniis. 

In  the  hrst  section  helow  we  set  up  the  prohh'in  and  calculate  the  optimal  policy  Ini  finite  n.  In  the 
next  section  the  limiting  form  of  this  policy  as  n x:  i>  discovered.  I i the  final  seetinii  a sli(:htly  dif- 
ferent prolilem  is  formulated  and  its  optimal  polii  y for  finite  n and  i*>  !imitin(i  optimal  policy  are  >riven. 

We  remark  at  this  time  that  the  context  nl  sei-retaries  interview iii(:  for  pihs  is  retained  inainlv 
heeause  nf  historical  interest.  The  prnhiem  discussed  ei  rtainly  has  other,  prnhahly  more  interestiiif;. 
applications  anytiim  a decisinn-iiiaker  wishes  to  choose  the  k best  nl  ri  sei|uentially  arriviiik:  nhiects. 
*\  possible  exainfile  is  where  there  are  several  assembly  lines  inr  several  produetimi  plants!  which 
jointly  must  till  k special  orders  Imm  the  next  ri  item-  produced.  The  lines  may  differ  as  to  quality 
and  the  probability  that  a (tiven  line  is  the  m-xt  to  produce  an  item  may  depend  on  the  line  which  pm 
duced  the  previous  item,  as  confirmed  by  historical  records,  II  a decision  musi  be  made  on  each  item 
as  soon  as  it  is  produced,  then  our  model  can  be  u-cd  to  sequentially  choose  the  best  /.  in  an  optimal 
manner. 
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Preceding  page  blank 
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2.  OPTIMAL  POLICY  FOR  FINITE  n 


Lei  7|',  Ti!.  . . . Im*  the  successive  stales  of  an  r — stale  Markov  eliain  with  transilion  prolial>ilities 
q,j.  Associate  with  each  stale  i a se(|uenee  of  i.i.d.  non-negative  random  variables  Y', . . . . from 

disirihution  F,.  Then  we  assume  the  value  of  the  )lh  secretary  is  a random  variable  ,Y,.  where 


■v,=  2:.yi„ 


and  I ( is  the  indicator  of  the  set  4.  V»  e a?<sunie  that  when  a secretary  is  interviewed,  both  the  value  of 
Xj  and  the  disirihution  it  comes  from  are  <d>served.  The  followin':  iheoretn  t:ive‘.  the  optimal  policy 
for  any  k and  it. 

THKOKKM  I:  Assume  there  are  n •.eerelaries  left  to  interview.  Then  there  are  tiumhers 
0 = a,  „ ft,'  „ € ...  € ti,;  I „ „ such  that  if  there  are  / -s  n |ohs  still  vacant  atul  the  next 

secretary  has  a value  .»  frotn  distrihulion  F,.  she  should  he  hired  if  and  only  if  ,t  S n;, 

Furthermore,  suppose  that  iti  an  n sec  retary  pndiletn,  the  first  secretary's  value  eotnes,  frotn 
distribution  F„  a decision  is  made  on  her,  and  then  n—  I see  t claries  and  I.  vacaticies  remaiti.  At  this 
point  the  sum 


is  the  optimal  expected  reward  from  the  k se<-retaries  who  will  evetitually  he  choseti.  That  is,  ^ 
may  h<-  interpreted  as  the  iticretitental  value  from  havini:  k vacancies  instead  of  /,  — 1. 

Finally,  the  critical  values  may  he  ( alculaled  from  the  recursion: 


r ( r ,1 

la  I V ^ “ 


xF,(dx) ,„F,{(i„ 


\-F 


I ) 


where  the  convention  is  that  ^ ■ 0 when  m = n. 

I’KOOF:  The  proof  will  he  otttilled  sitn-e  it  is  a siraifxhtlorward  induction  proof  on  n.  The  recursion 
ill  follows  frotn  the  interpretation  ol  , jiivcn  above. 


3.  LIMITINC  RESLLTS  FOR  LARGE  n 

This  section  deals  with  the  case  where  n—*^  hut  kjn  approaches  a tion/.ero  limit.  In  particular  wc 
will  hnd  liiti  «/  , and  litti  .4, in.  w)ln  lor  a fixed  fraction  0 < rr  < 1.  where 


M 

■4,in.n)=  ^ 

m ( HTT  I . I 


and  [nn-]  is  the  (.'reatest  inlejter  iti  nn.  Note  that  from  Theorc-tn  1..4  (ri.  rr)  is  the  opiitnal  total  expected 
value  from  n secretaries  fdliny:  n — [rw]  vacancies,  (liveti  that  the  itrevious  secretary  was  from  dis- 
trihulion j.  e find  the  limit  of  this  quantity  divided  hy  n hy  compariti"  the  optitnal  policy  with  a suh- 


P^PjilUlill^iljji.  II 


It'  ,?ys?w>.?w 
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optimal  policy  to  obtain  a lower  bound  and  an  impossible  but  better  than  optimal  policy  to  obtain  an 
upper  bound. 

First  we  define  some  notation.  Assume  the  .Markov  chain  governing  the  successive  distributions 
is  ergodic  and  let  pi,  . . .,  pr  be  the  associated  steady-slate  probabilities.  Let  /,(«)  be  the  number  of 
A”s  from  distribution  F,  out  of  the  first  n,  and  let  r'i(i),  f . . . denote  the  indices  of  these  A's. 
Define 


Z'(a)  = l i.V'^,11  and  F',(«)  = A'|i.v  .'«i, 

j J j 


and  then  for  any  « and  li,  let 


St  in) 


= Si{n:  «,/>)  = min  fm  ^ Zj,  ,,,(a)  [n/<]  j 

t,(n)  ^ t,{n:  a,  />)  = min  {l,{n).Si(n)). 


Finally,  for  any  0 « tr,  « I and  I « / « r,  denote  by  F.  Mir,)  any  of  the  numbers  t which  satisfy  Fdr)  ■ 
(r„  and  let 


The  following  three  lemmas  will  establish  the  lower  bound  mentioned  above. 

I. EMMA  1:  Let  0 ^ tr,  « 1 be  any  number  for  whicb  {r  |A'i(r)  = it,}  is  nonempty,  and  let  5i(n)  = 
Si(n:  F;  '{<r,),  p,(l  -cr/)).  Then 


lim  Eti(n)ln  = (},. 

« -»x 


PROOF:  Since  0 « /i(n)/n  ^ /,(n)/n  « 1,  it  suffices  by  the  bounded  convergence*  theorem  to 
show  that  ti(n)ln—*  p,  in  probability  as  n — ♦ |,t-i  e > 0.  Then 

P{t,{n)ln^  pi  + f]  ^ /•'(/,(  n)/n  &p,-fe)  —>  0 as  n—*^ 
by  Markov  chain  theory.  .Also 

F{t,{n)ln  ^ p -e)  < P{l,{n)ln  « p,  — € ) + P(.s,(n  )/n  « p,  — c) 
and  again  the  brsi  term  on  the  right  goes  to  0.  For  the  second  term,  wc  have 


P(s,(n)ln  ^ p,  — €)  = P (s,[n)  ^ [ 

nfp,  — el] ) 

j |nl/>.  »l| 

1 ./=! 

^ [npid  — (T,)] 

! "U''>-P '•*  I!'- 1 ' J ’ ■' 
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= P 


= P 
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ln(p,-«l] 


J=l 

[n(p,-fl 

I 

j-  I 


Z'(F,  ‘(cr,))  ^ [npi(l  — q-,)] 
[n(py-£)]  " [n(p,-e)] 


and  this  term  fioes  to  0 by  the  weak  law  ot'large  numiters,  since  the  Z's  are  i.i.d.  with  mean  1 — cTjand 


lint 


[np,(  1 — Q-/)]  _ 1 -(fi 
[n(p,-£>]  l-e/pi 


> 1 


LEMMA  2;  I ^-t  (r,,  s,{n)  and  tiin)  he  as  in  Lemma  1.  Then 


lim  E 

n 


M«l 


I n.n 


(/■Vu^)) 


n = p,fx,(tn). 


PROOF';  Define  A(l)  to  he  tlie  set  of  possible  realizations  of  i'i(i),  r-jU),  ■ ■ ■ when  l,(n)  = l. 
Also,  for  i>  ■=  {i>\.  . . .)e/U/},  let  .4  (/.  e)  = {/,(n ) = /;  i>j{i)  = i>,.  all  J}.  Notice  that  A {I,  c ) is  simply 

a subset  of  the  prohahility  space  associated  with  the  Markov  chain.  Furthermore.  AU)  and  A{/,  c) 
are  obviously  dependent  on  n and  i,  although  this  dependence  has  been  su|)press(“d  for  notational 
convenience.  Then. 


fjn) 


(Ei  '((r,)) 


s s ^ 

I I « HI) 


lAn) 

1 n 


{E,  M<r,)) 


A(Ei’) 


P(A{Lf)) 


On  the  set  A(l,  c),  (/(n)  is  a finite  stopping  rule  for  the  i.i.d.  1,' ‘s.  so  by  Wald's  equation  and  inde- 
pendence the  above  expression  is 


2 2 E(t,(n)  |/<(/,  c))£’{F;(f’.'(<r,))}P(4(/.c)) 

I itAU) 


n=  {Et,(n  )/n  )p,(o-, ) — ► p,p,(tr, ) as  n -♦  x. 


by  I.emma  1. 

LEMMA  3:  Suppose  Ei,  . . Er  are  <'onlinuous.  Then  for  any  0 < tt  < I there  exist  fractions 
0=e(7j^l,  1 « / « r,  for  which  ip,<r,=  7T  and  E|'((ri)=  . . . = F’,. ' ( ir, ) . Furthermore,  for  these 
cTi’s  a. id  any  1 « y ^ r. 


lim  inf/4j(n,  tt)  / n > ^ p,p,((r, ). 

PROOF;  The  existence  of  the  <r,'s  follows  by  looking  at  solutions  of  F'l ' (iri ) = . . . — /■ 
ar.d  then  adiusting  b until  ipitr,  = 7r. 

Recall  that  we  are  trying  to  Hll  n — [rirr]  vacancies  with  n secretaries.  (Consider  the  infeasible 
policy  which  hires  at  most  [np,(l  — fr;)]  of  the  secretaries  from  distribution  E,  and,  with  this  restrie- 


\1ARK()\  CHAIN  SKCKtTAKV  155 

tion,  hires  only  those  secretaries  from  Fj  with  a value  x^F,  ‘(o’,).  This  policy  is  infeasible  because 
the  vacancies  may  not  all  be  filled,  but  since 

r r 

^ [np({l  -o-,)]  S ^ npid  — O',)  = n(l  — tt)  « n - [nn-], 

i=l  (=1 


the  policy  will  never  hire  too  many  secretaries.  If  R„  is  the  value  obtained  from  this  policy,  then  the 
part  of  ER„/n  due  to  the  X''s  is  exactly  what  we  examined  in  Lemma  2.  and  its  limit  as  n — ♦ ^ is  given 
in  Lemma  2. 

Now  compare  the  aliove  policy  with  a feasible,  iionoptiinal  policy  whicb  hires  only  those  secre- 
taries from  Fi  with  a value  x ^ F^  '(<r,)  until  there  are  as  many  secretaries  left  to  interview  as  there 
are  vacancies,  if  this  ever  occurs.  Then  hire  all  remaining  sei  retaries.  If  R„  is  the  value  obtained 
from  this  policy,  then  the  non-negativity  of  the  ,V's  implies  that 

r _ 

V piiiiitTi)  = lim  FRuIn  « lini  tn( FRJn  ^lim  inf/1, (n,  n)ln. 

^ ^ n .r.  fj-at  n.3c 

i = I 


Next  we  find  an  upper  bound  on  the  optimal  expected  reward. 

LEM.MA  4:  Assume  Ft F,  are  continuous  and  let  trt.  ...  (Jr  be  us  in  Lemma  Then 


lim  sup  .4,(n,  7r)  / n ^ 


PROOF:  Recall  that  A',  is  the  valui-  of  the  pit  secretary  and  let  .V,,, V,„i  be  tbe  order 

statistics  associated  with  X V„.  Then  since  no  se«]uential  hiring  policy  can  (it  better  than 

hiring  the  secretaries  with  values  A’,|„n-|.i, it  suffices  to  show  that 


(2) 


lim  sup  F 

II  -•» 


I ^ 


HI  ( HIT  j • I 


( HI  ) 


-2  S''-' 


l>l  I I 


n «() 


where  .'Hi.  j)  is  the  event  that  X,  is  from  distribution  F,  and  X,3-F,  '(tr, ) = /■’,  '((r,).  This  suffices 
because 


lim  F 

n 


f I 


(1=2  p,p,Ur, ). 

I I 


H r 

Define  = 1 k,.,i  and  ,\(n)=2  A,(n).  'fheii  the  right-hand  doufile  sum  in  (2)  contains  ,V(  n ) 

j=i  1=1 

nonzero  terms,  all  greater  than  or  et|ual  to  F,  '(<ri).  whereas  the  left-hand  sum  contains  the  ii  — [iitt] 
largest  A",'s.  Therefore  the  expectation  in  (2)  may  be  written  as 





aiii'iiai'-riTirit^ 
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I (n—  [/177]  — /V(n)  terms,  all  ^ h\  '(<rt)) 

J(  \(  n)*.n  ( nir)) 

+ f (A^(n)  — n + [wtt]  terms,  all  « — f’ ,'((Ti) ) I / n « f’lMfrilfln  — [nrr]  — A^(n)  / n. 

H Iiitt))  J / / 


However,  sinee  jini^  £'A^,(n)/n  = pi(l  — cr,)  and  1 — cTi)  = 1 — rr,  the  above  expectation  goes  to  0. 
This  shows  that  (2)  holds,  and  the  proof  is  complete. 

We  put  the  preceding  lemmas  together  to  establish  the  following  theorem. 

THEOREM  2:  Let  E,,  . . .,  f r and  (7i,  . . .,  (Tr  be  as  in  I.emmas  3 and  4.  Then 


lirn 7r)  j n = pipdo-j). 

Corollary  1 below  lists  two  interesting  results  on  sums  of  order  statistics  associated  with  Markov 
chains.  The  proofs  follow  easily  from  l.emma  4 and  Theorem  2. 

COROLLARY  I:  I nder  the  same  assumptions  as  in  Theorem  2,  we  have 


and 


II  IT 

jimf  2 A’dii)  / n=  ^ pip,(cr,) 

m = I «it|  • I ' i-  I 


(«»r|  ] / r 

jiuiE  ^ Aimij  j n=  pdpifO) -pi((T,)). 


The  following  proposition  perhaps  gives  a more  intuitive  reason  why  the  cr,’s  of  Theorem  2 are 
associated  with  the  optimal  hiring  policy.  Its  proof  is  straightforward  and  hence  is  omitted. 

PROPOSITION  1:  If  Ei fV  and  are  as  in  Theorem  2,  then  these  ot’s  also 

maximize  1p,pi{ui)  subject  to  2 OiiTi—  rr,  0 ^ cr,  =£  1. 

Finally,  we  use  Theorem  2 to  olitain  a limit  on  i itself.  Assuming  the  Wi's  are  as  in  Theorem 

2,  define  x(Tr)  to  be  the  common  number  Ei'(<ri)=  . . . =f'r'((Tr).  Also  define  p(x)  = SpiEi(x) 
and  assume  that  g is  strictly  increasing  in  a neighborhood  around  x(7r).  Then  g ' is  defined  in  a 
neighborhood  around  tt  since  gfxfrr))  = n.  so  that  x(7r)  =g  '(n).  We  use  this  to  obtain  the  following 
theorem. 

THEOREM  3:  If  h\.  . . .,  hr  are  ea«-h  absolutely  continuous  and  g and  x(7r)  are  defined  as 
above,  then  for  any  0 < TT  < 1 , lim  aJ  , =x(7t). 

Innl.  I.  .1 

PROOF:  .Since  the  proof  is  very  similar  to  the  analogous  proof  of  Theorem  2 in  |2].  it  will  be 
omitted. 

The  above  theory  has  two  important  implications  for  implementation.  First,  although  the  optimal 
policy  in  Theorem  1 is  simple  to  administer  if  the  ain, /s  are  known,  these  critical  numbers  may  be 
difficult  to  calculate.  By  Theorem  3,  however,  there  are  simple  approximations  for  the  critical  numbers 
which  may  be  used  instead,  at  least  for  large  n,  to  achieve  near  optimality.  Second,  the  feasible,  non- 
optimal  policy  described  in  the  proof  of  Lemma  3 also  yields  nearly  optimal  results.  Furthermore. 
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this  policy  is  trivial  to  administer  and  calculate  since  there  is  a sint'le  time-independent  critical  number 
lor  each  distribution  which  should  be  used  until  there  are  as  many  vacancies  as  secretaries  to  be 
interviewed.  Past  this  point  all  secretaries  would  be  hired. 

Finally,  we  mention  a special  case  of  the  above  model  which  is  pridiably  more  realistic  in  many 
situations.  This  is  when  the  next  distribution  is  independent  of  the  most  recent  one.  that  i.',  when 
Qij~Qj  each  (,  /.  However,  our  results  then  hold  by  taking’  r=  1 and  usinfi  the  distribution  F=  y.q,Fi 
which  is  a random  mixture  of  the  (tiven  distributions. 

T.  ANOTHER  SECRETARY  FROBEEIR 

.Suppose  tbe  abo\c  model  is  chantied  so  there  are  r catefiorics  of  jcdis  such  that  a secretary  from 
distribution  F,  can  be  used  only  lor  vacancies  of  typi-  i.  In  this  case  it  is  convenient  to  think  of  r 
decisionmakers,  each  dealing  with  a sinjile  <'atc}iory  of  jobs,  ami  each  (ree  to  make  his  decisions 
independently  of  the  others.  Also,  wc  should  now  think  of  the  number  of  available  type  i jobs  as  simply 
a maximal  number  «d  opcnint:s,  so  that  if  less  than  this  many  type  i secretaries  arrive,  there  is  nrt  penalty 
for  unfilled  positions.  For  this  problem  we  list  results  analogous  to  those  in  tbe  previous  two  sections. 
Since  the  prmds  of  these  contain  no  really  different  ideas  than  those  in  the  previous  sections,  we  omit 
them. 

rilFOKFM  4:  Assume  there  arc  n secretaries  remaining  to  be  seen.  Then  there  are  numbers 
**  ~ "o.ii  ii'^  ■ ■ • ' "'ll  i.ii'^  "'ll. 11^  *•  such  that  if  there  are  I ^ n vacancies  of  type  / and  the 
next  secretary  has  a value  t from  distribution  F,.  then  she  should  be  hired  if  and  only  if  t ^ 

Furthermore,  if  n — 1 more  sc(  rctaries  remain  to  be  seen,  then*  arc  A vacancies  of  type  i.  and  the 
previous  secretary  was  from  distribution  llu*n  the  sum 

i";.  i.i, 

1 1 

is  the  optimal  expected  reward  from  hiriiif.'  the  type  / secretaries.  That  is.  „ is  the  incremental 

value  from  having  I openings  of  type  i instead  of  only  /.  — 1. 

Finally,  these  critical  numbers  may  be  calculated  fr  nn  the  recursions: 


f'M.ii 


" I . II  • I */" 


X F,{(lx)  -+  a\  „ f 1 — /■'ifn'i  „ ) ) 


and 


a' 

t , n • 1 

= ii-<7ii)";  , 

.11  1" ' 

1 f" 1 ■ " . . 

I X F ,i (lx 

i.ii 

(1-F, («;  ,,)) 

1 t 1 . II 

for  2 n. 

Now  sui)posc  //  secretaries  remain  to  be  seen,  the  previous  secretary  was  of  type  i.  and  n — [nrr] 
vacancies  of  type  i remain,  wln*re  0 < tt  s:  f.  Then  the  o|>timal  total  expected  reward  from  the  secre- 
taries hired  to  these  jobs  is,  by  Tin  irem  4. /4,fn.  tt).  Again  we  obtain  a limit  theorem  for  this  quantity 
in  the  interesting  case  where,  in  the  limit,  th<*re  arc  not  enough  type  i jobs.  As  before,  we  assume  the 
.Markov  chain  is  ergo<lic  with  stationary  distribution  {pi}. 
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THKOREM  5:  Kor  1— pi''  7r<l,  let  (r,=  1 — ( 1 — 7r)/p,.  and  assume  {t  | E, (t)  = fr*}  is  non- 
empty. Then  lim  Ai{n.  n)ln  = pitJ-Atri). 

THEOREM  6:  Suppose  /•’*  is  absolutely  <'ontinuous  and  n and  cTj  are  as  in  Theorem  5.  Then 


.\lso,  let  Wi=sup  {jr  | f',(x)  = 0}.  Then  for  0 < n-  <1  — p,. 


Ue  eonelude  lliis  seetion  hy  deserihiiif;  one  possilile  setting  for  the  model  of  this  section.  Suppose 
the  different  categories  of  vacancies  refer  to  different  levels  of  necessary  (jualifications.  Eor  example, 
level  1 might  he  relatively  menial  work,  whereas  a higher  le\L-l  might  he  a more  responsible  position. 
Also  assume  that  the  values  of  all  secretaries  come  from  one  distribution  F,  but  there  are  fixed  nundiers 
0 = /()«/,  « . . . ^ tr  I ^ <r  = ^.  such  that  a value  x satisfying  /,  , < x < t,  can  only  be  considered 
for  level  i.  This  fits  our  model  if  we  let  q ji  = q,  = F{ti)  — F{t,  i)  and 


Fiix)  = 


F{x)-Fu,  ,) 
Fit,)—F{ti  i) 
0 
1 


t,  ,<X<li 

jr « h I 
X>li 


5.  CONCLIUINC;  REMARKS 

Before  concluding,  we  make  several  remarks  which  are  pertinent  to  the  above  results.  In  section  2 

it  is  possible  that  the  distributions  F, fVare  degenerate  at  the  points  x>.  respectively. 

Then  we  would  actually  be  <ibserving  a Markov  chain,  where  being  in  state  i would  mean  observing 
Xi.  In  this  case  equation  (1)  takes  the  form 


(i  in . H • 1 V J 


I ; 

' I,  ir  J'j- 


' m . tfi  in 


is, 


J + (i-* 

m J . n * tr 


I =s  r. 


il'l 

where  l(j-,  n is  1 if  xtA  and  0 otherwise. 

Second,  as  in  [1,  2.  .3]  any  of  the  above  results  may  be  generalize*!  to  the  case  where  there  are  n 
fixed  quantities  pi  . . . ^ p„.  or  r sets  of  p's  in  the  model  of  section  4.  which  must  be  assigned  to 
the  n .\'s,  so  that  a p assigned  to  an  x rec-eives  a n-ward  px . lOur  p's  were  all  O's  and  I's.)  The  basic 
results  are  that  the  same  sequences  of  uii,  ,,’s  determine  the  optimal  policy  for  any  set  of  p's.  Eor 
example  in  the  model  of  section  2.  if  n p's  re.nain  and  the  next  .x  satisfies  a'  < x <a‘  , then  p, 
should  be  assigned  to  this  x.  The  reader  is  referred  to  |l]  for  more  complete  results  along  this  line. 

Einally,  further  work  should  he  ilone  on  the  case  where  only  the  values  of  the  .r's,  not  their 
distributions,  are  observed.  In  some  contexts  this  wiiuld  seem  to  he  the  most  realistic  approach. 
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However,  there  are  also  many  cases  where  qualitative  differences  in  the  secretaries,  or  whatever 
objects  are  being  observed,  immediately  identify  the  distributions  from  which  they  come,  and  this  is 
the  rationale  for  the  approach  taken  here. 
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the  rationale  for  the  approach  taken  here. 
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ABSTRACT 

In  this  note  we  analy^e  ihe  fraolional  inl<-rval  protiramminp  problem  iFll’)  and  find, 
explicitly,  all  its  optimal  solutions. 

Thoupli  our  results  are  essentially  the  same  as  those  in  (iharnes  and  (iooper  |4],  the 
proids  and  analysis  we  provide  here  are  considerahly  simpler. 


0.  INTRODUCTION 

Charnes  and  Cooper  [3]  provided  a complete  analysis  of  the  linear  fractional  programming 

problem  in  all  generality,  and  reduced  the  fractittnal  prtrblem  to  at  most  a pair  of  ordinary  linear 

programming  problems.  They  further  applied  the  results  in  |3]  to  obtain  an  explicit  optimal  solution  to 
a general  class  of  linear  fractional  problems  — those  for  which  the  constraint  set  is  given  l>y  d~  /4x  ^ b' 
and  A is  of  full  low  rank,  see  [4].  These  problems  were  termed  fractional  interval  programming  problems 
(FlP)see  [1,41. 

In  tliis  note  we  analyze  the  full  row  rank  (Kll*)  and  find,  explicitly,  all  its  optimal  solutions.  Though 

our  results  are  essentially  the  same  as  those  in  [4],  the  proofs  and  analysis  we  provide  h**re  are 

considerably  simpler. 

We  transform  the  (FIP)  problem  to  an  equivalent  problem  in  which  all  the  regular  cases  are  easily 
detected.  Further,  unlike  in  |4],  we  do  not  apply  the  Charnes  and  Cooper  transformation  from  a frac- 
tional linear  problem  to  an  ordinary  linear  problem  in  order  to  find  an  explicit  optimal  solution  to 
(FIP).  Rather,  the  optimality  of  the  solutions  we  generate  follows  from  a well-known  property  of  the 
fractional  function. 


1.  THE  (FIP)  PROBLEM 

(Consider  the  fractional  interval  programming  problem  (FIP)  of  the  form 


(1) 


Max 


C^X  + c'n 

3^X  + d» 


*Thi!'  rrsparcli  was  partially  supportpd  h>  <iranl  No.  A-4024  and  tiy  Office  of  Naval  Research  (iontracts  N000I4- 

67- A -01 26-0008  and  N(K)014-67-A-0009  with  the  Oriiler  for  (^yhernelic  Studies.  The  I niversily  of  Texas,  Austin.  I'exas. 
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subjet't  to 

(2)  b-^Ax^b^ 

where  A is  of  full  row  rank  (see  [1,  4]). 

Let  us  assume  that  (FIP)  is  feasible,  i.e. 

(3)  S={xeR":  b-^Ax^b^}^0. 


ASSUMPTION  1;  + <?o  constant  on  S. 

ASSUMPTION  2:  There  does  not  exist  a constant  Xe/?  such  that  (c^jc  + co)  = X(5^>  + 5o)  on  i. 
Since  A is  of  full  row  rank  it  has  a right  inverse  denoted  by  A* . Substituting 


(4) 


y=Ax 


or 


(5) 


x = A*y+(/  — A*A)z,  i arbitrary 


in  (1),  (2)  we  ol>tain  an  e<|uivalenl  problem  to  (FIP)  of  the  form 


(6) 


c'LA*y+  (/-A'A)z]+c„ 

^n^'y+(/-A'A)z]+^„ 

suhjeit  to 


(7)  b ^y^lr. 

In  order  that  (FIP),  under  assumptions  1.  2.  will  he  hounded  from  above,  we  further  assume  that 
1 (I  — A*A)  and  (7'  i {/—A*A).  A complete  analysis  when  1 (I  — A* A)  or  d'  JL  iI  — A*A)  is 
given  in  Charnes  and  Cooper  [4], 

Without  loss  of  generality  we  can  assume  that 


(8) 


b^  < b.'  U=  m). 


Otherwise,  if  b.  > b.'  then  (FIP)  is  infeasible,  or.  if  /)  = Ir  we  substitute  )i  = b^' . 
Denoting  l)y 


(9) 

and  substituting  in  l6)  and  (7)  r< 

(10) 


( t = 1 m) 


•suits  witlt  the  following  eiiuivalent  problem: 


Max 


I r'y-F  r,i 

I d^y  -r  do 


l’(.v) 


i 


i 


i 

I 
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subject  to 


0«y  € 1 


where 


d^=dU\  co  = Co.  do=t/o. 


We  can  assume,  without  loss  of  generality,  that  </,  5=  0 (i=  1,  . . m),  since  otherwise,  if  <4  < 0 we 

substitute  yic  = 1 

Without  loss  of  generality*  the  following  three  disjoint  and  exhaustive  cases  are  describing  the 
behavior  of  the  denominator  of  V (y)  on  Si  = {y:  0 « y ^ 1 }. 

ni 

I.  dn  < 0,  du  + ^ di  >0  (i.e.  the  denominator  changes  sign  on  Si) 

/=  I 

11.  du  = 0 (i.e.  the  denominator  has  a unique  sign  but  vanishes  on  Si) 

111.  d„  >0  (i.e.  the  denominator  does  not  vanish  on  S|). 

CASE  1:  Here  there  are  the  following  two  subcases 
(a)  For  some 


0<y<l,  dii+ ^ d,yj  = 0 and  Co+ ^ c,yj  > 0. 


Then,  F (y)  is  unbounded  on  S|.  see  C'harnes  and  (i<M>per  |4). 
( b)  For  every  0 =5  y « I , such  that 

IN 

dt,+  ^ d,y,  = 0 


we  have 


•+  £ c.y.  =0. 


Charnes  and  Cooper  [4]  proved,  by  the  aid  of  Farkas-Minkowski  lemma,  that  if  subcase  1(b)  holds 


we  ('an  always  multiply  the  numerator  and  the  denominat(»r  of  Tl  > ) liy  — I and  substitute  for  eac'h  > { I • 
for  which  r/,  < 0 a new  variable  y,  = 1 — y,  case  II  al»ove  a< c<»unts  for  lh«  siioation  where 


f/fl  ' 0 and  ^ f I = 0 


whereas  case  111  accounts  for  the  situation  where 


dll'  0 and  V d,<0. 


and  iherefori'  the  three  cases  defined  almve  are  dis|4>int  and  exhau-'tixe. 
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ihrn  F(y)  is  constant  over  .S',.  A difTcrent  elementary  proof  will  lie  ^iven  here. 

It  is  easy  to  verily  for  1(h)  that  c,  = 0 must  hold  whenever  r/,  — 0.  Moreover,  there  exists  a vector 
> ' = (yj.  . . > l„),  0<  > ' < 1 for  which 


ni 

^ d,y;=0. 

I - I 


Next,  let  us  construct  the  followint:  vector> 

v-  = ( >i-€. y.i, . . + • t ) v"'  = (yi 

(dearly,  for  €>0  and  sufficiently  small  we  have  that  0 ' v'  • I and 

till  + </'v'  = 0 I;  = 2 ml. 

l.tM\l\  I:  The  vector!"  v' y «on>trii<ied  above  arc  lincarlv  independent. 

PKOOK:  .V.'sume  the  contrary.  Then 

I 12)  <»l>  ' + . . . * — 0 

iinplie> 


. + (»ml  — <»,  • t = (I  li  = 2.  . . . mi 

</|  >1  'In,  I.  . 

■+  (»ml  + «((»;■  ~ -*  <»1  a . . 0,1,  '=  0 

(In,  (In,  (/,„ 

Now . if  lor  xoinc  2 * / ‘ m,  (»,  = 0.  then  <»  = 0,  , = 1 m.  I hii-.  il  v '.  . . . v aic  di  pcndcnl  w c 

mu«,l  have  (»,  ^0  ii  = 2 ml.  f urther  -.jii.  i-  t > 0.  v ' ■ 0 ii  = I mi  we  ohtain 

I If  I >i(:n(oia  . . . -•  (»„  ' - 'i;.'.n  i(v , I u = 2 mi. 

Now.  ‘.ince  (/,  >0(1=1 m ) we  • ooch.ide  th  '.t  th,-  la-t  l•l|uaIllm  in  i l.fl  c.iniiol  hold,  whn  h i orn 

|)lelc-  the  proof. 

l et  V he  any  <-lcme-nt  in  ,S,  lor  which  <l„  • <l‘\  0.  Then,  -ince  v i/  = I.  . . mi  'pan  H ".  \ i an 

he  uni(|uclv  rcpre>entcd  a>- 

m 

I l.')i  ' ” ^ ' 

.s>uhstilulin;i  I l.hl  in  l (v)  rc-ult!"  in 


(i;ii 


I-;  ,U‘i 


>',(<»,  -I  . . 
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f(i  + ^ fiic’’}'  Co  + ^ li,i—  ro) 

(16)  Hyl  = ^ = — = -p  = ciinstanl. 

do  + ^ pid^y'  do  + ^ (i,  do) 

I =-  1 1=1 

Thus  we  proved  that  if  I(hl  holds  then  J ( y)  = eonslani  on  .S|. 

(]ASE  II:  I.et  us  deni>le  hy 

/ = {/.•  r/,  = 0}.  /|  = {/:  It/,  r,  > 0). 

Now.  in  (]ase  II  the  following  two  subcases  might  occur 
lal  C(i  ^ <”i  > d- 

I)  1 1 


(ll)  Co  ^ 

o/i 


If  Ilia)  occurs  1 ( vl  is  not  hounded  from  above  on  .S|.  see  |4],  and  if  11(1)1  occur-  if  IP)  po--c--e-  an 
optimal  solution. 

An  algorithm  to  find  all  the  optimal  solutions  to  (KIP)  when  (la-e  llihl  or  (!a-e  III  li.r  the  dc 
nominator  is  unisignant  on  .S',)  occur  is  given  in  section  2. 


2.  EXPLICIT  SOLI  TIONS  KOR  (HP)  (CASES  II(L)  AM)  III) 

The  optimal  solutions  to  (FIPl  when  Cases  llthi  or  III  occur  are  obtained  in  the  following  manner 


Let 
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f or  all  indices  it/  -ub-titute  in  / mi 


/==  |/:  </,-()} 


( 18) 


1 

(I 

P' 


if  r,  > (I 
if  f,  ‘ 0 
if  r,  = (I 


and  denote  by 
(191 


r.i  = r„  ->  ^ r,>  *. 

I*  I 


Next  denote  b\ 


(2t)l 


r, 


y,  = 


= ^ At/ 


</. 


and  a-sume  lor  -implii  itN  tliat 
(21) 


V..  5? 


■yi  ^ y; 


~|-rn  liiliiiiiiiU 
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where  r — m — \l\  and  |/j  is  the  nuinlier  ol  elements  in  / Let  / l>e  the  smallest  index  for  which 


(22) 


c»  + X f, 


» 


/ . -y,- 

lln  -t-  ^ (I, 

I 


and  let  /,  he  the  smallest  index  /i  > / lor  which 

(23) 


I,  I 

<■«  + S 

j=> 


/,  1 =*  y.' 


^ ti, 


In  the  hillowinj!  we  shall  prose  that  the  set  of  optimal  solutiotis  s‘""  to  (KIP),  denoted  hy  1,  is 
t:i\en  li> 


(24) 


1 »'-/-! 

I>  I t • I,  0 % /',  1 

0 /.  V r ^ r 

»•  If! 


In  |4|.  (diarnes  and  Camper  es.ahlished  the  optimality  of  a solution  for  (KIF').  generated  hy  (22), 
hy  exploitinyt  the  spect!  structure  ol  the  pair  ol  dual  linear  pro^’ramming  |)rohlems  obtained  after  ap- 
plying their  well-known  transformation  which  was  introduced  in  |3j. 

An  elementars  proof  lor  the  optimality  of  1 is  given  in  the  hdlowing: 

I K.MMA  2:  Kor  any  two  fractions  Ui'f'i-  nj  /»-.  for  which  ti],  h>  ^0  we  have 


.Min 


!L' 

Ol  a> 

Max 

Ti' 

(ll 

f'l' 

h: 

ll,  -+  b ; 

, I'i 

whenever  iii  h.  * 

PKOOK  .supjiose  a, ill,  ■ Then. 


Min  \ii,!l),  . 0;//c’|  = It, III,. 


Also. 


(I  -/i;  ' tijh,  =J>  ii,h:  il,li,  ' “ <ti/'i 

11,1  h,  h_)  ■ h,[(i,  -•  (1..  I 

il\ll>\  < («i  ^ a;)lih,  -s  h.) 


4>  Min  (ui/fii.  (iilti,  s.  (a|-t-  a..)/(fii  + b,>). 
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j;  Similarly,  it  can  l)e  shown  that 

i' 

(«i  +Ui)l{h,  + h>)  Max  [oilht,  a>lh>]. 

\ l-Tom  Lemma  2 and  the  manner  with  which  (24)  was  constructed  we  conclude  that  the  set  Y consists 

of  all  the  local  maximum  solutions  to  L (y)  over.S’i.  Now,  since  every  local  maximum  to  L(y)  is  also  a 
slohal  maxiriui..,  see  e.{i;.  [6],  the  filohal  optimality  ol  the  set  Y follows. 
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A NOTE  ON  TESTING  FOR  EXPONENT! ALITY* 
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ABSTKACr 

In  this  not(‘  somr  extrusions  are  made  l<»  previous  work  by  a number  of  author**  on  the 
development  <d  tests  for  exponentiality.  The  most  recent  example  is  due  to  Kereho  and  Ringer 
in  whieli  tliey  ( cmipare  the  -*mall  sample  powers  of  a lew  well-known  lest  statistics  fi>r  the 
hypotliesis  of  a constant  laihire  rate.  It  is  the  primary  intent  <»f  this  current  work  to  extend 
(medenko's  F lest  to  <*ituatiofis  with  hypercens<ihng  and  t<»  provide  guidance  (or  its  use. 
particularly  when  a log-normal  distribution  is  the  alternative. 


1.  INTRODUCTION 

Tliere  have  lieen  numerous  [)ap»Ts  over  the  years  on  the  most  appropriate  choice  of  test  statistic 
for  the  hypothesis  of  exponentiality.  A recent  example  is  a paper  hy  Kercho  and  Ringer  [2],  in  which 
the  auiliors  compare  tlie  small  sample  powers  of  four  well-known  test  statistics  for  the  hypothesis  of  a 
constant  failure  rate  versus  the  hypothesis  of  a nonconstant  hazard.  The  tests  were  compared  for 
samples  of  size  n=  10(5)50  using  Weihull  alternatives  with  shape  parameters  varying  from  0.5  to  2.5 
(thus  allowing  both  IFRs  and  DFRst  The  four  tests  used  were  the  classical  F (first  posed  for  this  prob- 
lem in  Gnedenko  et  al.  [4] ),  <wo  tests  due  to  Epstein  [1],  and  a final  one  due  to  Hartley  [5].  In  their 
conclusions  the  authors  also  mention  the  application  tif  Kolmogorov-Smirnov  techniques  to  this  problem 
as  formulated  hy  Srinivasan  [8],  to  which  this  author  would  like  to  add  the  work  of  Lilliefors  [7J  and 
a further  related  paper  hy  Finkclstcin  and  Schafer  [3].  In  the  end.  .Messrs.  Fercho  and  Ringer  come  to 
the  decision  that  their  results  provith-  a mixed  hag,  though  the  F test  seemed  to  have  the  best  overall 
performance. 

It  is  the  primary  intent  of  this  note  to  extend  the  (inedenko  F test  to  situations  with  hypercensoring 
(i.e.,  removals  occurring  in  a completely  random  fashion  up  until  the  very  last  failure),  and  to  provide 
hints  on  the  use  of  the  F.  particularly  in  the  event  that  the  alternative  is  a log-normal  distribution. 

2.  THE  TE.ST 

•Most  methods  for  goodness-of-ht  ri'quirc  complete  samples  (to  he  distinguished  from  those  that  may 
he  censored,  truncated,  etc.)  for  their  implementaiion.  .As  pointed  out  hy  Fercho  and  Ringer,  this 


*Tb;**  wt»rk  wai>  .‘iUfipttrtrd  bv  ibr  I .>.  Orta  r n|  .Naval  K**M*arrb  uiuler  < onlra<i  No.  .N(MKIl'l-67-\-0214  v%hrn  llu*  author 
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problem  can  be  somewhat  circumvenle<l  in  the  exponential  censored  case  l)v  consideriiifi  the  sequence 
of  normalized  spacings 


S,=  — 1)  i), 

where  the  hypothesized  exponential  data  points  are  arranged  so  that  all  n interoccurrence  periods  begin 
at  time  /o  = 0 and  f,  denotes  then  the  lime  of  the  /ih  occurrence.  In  the  reliability  context,  this  amounts 
to  putting  all  items  on  test  at  the  same  lime  and  then  S,  becomes  the  total  lime  on  lest  between  the 
(i— l)st  and  /lb  failures.  It  can  then  be  shown  that  under  the  assumption  that  the  lailurc  litnes  arc 
exponentially  disirihuled,  the  nortnalized  spa<-ings  wi’l  , Iso  be  exponential,  with  exactly  the  same  mean. 

Hut  this  result  can  be  made  even  more  powerful  by  allowing  for  hypereeiisoring.  and  it  turns  out  to 
be  still  true  that  the  nortnalized  spacings  are  indet‘d  exjionenlial.  A proof  ol  this  ('(intention  lollows 
(with  no  loss  in  generality)  for  the  two-item  case. 

Suppose  two  items  are  pul  on  test,  each  with  e\pon:'ntial  failure  distribution  /•'(»)=  |— e *■'. 
Then  let  T=min{A’i.  As},  so  that 

T,  (y)=/^r{min(A,.  A,}  ^ y)  = l-/Vi.V,  > v|  > v) 

= 1 - e 

Hence  Y follows  the  exponential  distribution  with  parameter  2A.  Now  suppose  one  item  is  censored  at 
lime  \ * if  it  is  still  alive  (hen.  and  let  T be  the  total  lime  on  lest  until  the  first  failure.  .So 

i2}’  forlst* 

ijt*+V,  for>'>»* 

and  G I (t ) — Hr{2Y  « t and  1 ^ t * } i IG{\*  KVi  r and  ) ■ t * ) . 


CASK  I:  /■s=2v^ 


Here 

and 

rherefore 


CASK  II:  t -lx' 


N( 


/V(2K-  t and  )' v x*\=rr{Y^  f 2)  = I - e 


r-.’and  1-  r *}=(). 


C ; ( n " I 


/V{2>'^  rand  ) » * ) ' I > - ' * ) 1 " 


/V(.V,  < r - i*and  ) A,  - t - x^  \ ■ l>r{.\ , ^ x* 


...  ....vs........... . 


TESTIN<;  K)R  KM'ONKM  lAI  ITY 


Xe  ^'ds. 


GiU)=\-e  *'♦ 


Ap  ■ 


= „ kjr*\„  \(l 


(/}  = e *-'*Ap 


riitTflorc  T follows  the  expon*-ntiul  (listril>ution  with  parameter  A. 

For  tills  /•'  lest,  the  first  r and  last  («  — r)  of  a set  of  n norniali/.cii  spacinfis  (as  defined  earlier)  from 
the  hypothesized  exponential  are  firouped.  + Then,  since  the  .S’,  are  independent  and  id(‘ntieally  dis- 
triluiied  exponentials  with  exactly  the  same  mean  as  the  underlying:  distrihution,  it  fidlows  that  tlie 


statistic 


I I 

^ .S,/(n-r] 


is  the  ratio  of  iiidefiendent  Frlaiif:  variables  and  thus  follows  an  F distrihution  with  2r  and  2l/i  — r) 
de|:rees  of  Ireedoin  when  the  hypothesis  of  expommtialily  is  true.  I'herefore  a two-tailed  F test  would 
he  performed  on  the  (J  calculated  irom  the  set  of  data  in  order  to  determine  whether  the  stream  is  indeed 
truly  exponential.  It  should  he  noted  that  a one-tailed  ti‘sl  is  to  he  used  when  there  is  specific  information 
that  the  alternative  is  IFH  or  [)FH.  This  is  so  hecause  an  IFR  (DFR)  should  yield  a Q statistic  > ( < ) 1 . 
Furthermore,  any  kind  of  information  regardiii}:  the  possible  shape  of  the  alternative's  hazard  (unction 
can  trenerally  he  used  to  improve  the  powfr  of  the  F test  hy  providiiij:  a more  rational  means  for  selecting: 
the  way  to  divide  the  data  in  two.  This  is  so  hecause  under  the  null  hypothesis  of  exponentiality.  the 
maximum-likelihood  »-stimator  ol  the  hazard  over  any  interval  is  simply  the  number  of  tailure  times 
(allint:  in  that  interval  divided  hy  the  total  time  on  test  accrued  over  that  period  of  time.  The  usual  split 
at  r—  [n/2]  is  especially  nonoptimal  whenever  tlie  hazard  is  U-sliapiol.  as  it  may  he  in  lof;-nornial  cases, 
a point  explored  in  more  detail  later. 


:i.  .SOME  KESU  TS 

A numhcr  o(  power  coiiiparisoiis  wi'H'  made  to  permit  tlie  tcstiiif:  of  the  (casihility 'of  any  new 
approaches  to  llii'  suhiect  |iiohlern.  .Sample  sizes  were  restricted  to  10.  20.  .'fO.  and  40.  and  ^uns  were 
made  with  1 .(KK)  repetitions  lor  each  sam|ile  size  at  both  the  O.O.S  and  0.01  levels  ol  siftnihcance.  A 
number  of  s|)ecific  (!DFs  were  selected  for  each  alternative  and  results  were  based  on  a two-sided  test, 
or  a one-sided  test  whenever  the  alternative  had  either  an  IFR  or  l)f  K.  power  test  was  also  performed 
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lor  the  modified  K — S statistic  ol  Finkelstein  and  Schafer  for  a lo{;-n,irinal  alternative  usiiif!  the  critical 
values  contained  in  [3].  This  variali  m on  the  usual  K—S  theme  due  to  Finkclsleiti  amf  Schafer  is 
called  the  statistic,  and  is  tiiven  hy 


{max[  I //n  — F (/ , ) |,  | F ( t ,)-()- 1 )/n  j ][ . 

j I 

I'o  compare  these  results  to  those  of  Fereho  and  Hinder,  the  reader  i--  referred  lo  their  I able  3.3. 
where  jtf  = 1.5.  We  have,  in  addition  to  providinfi  a run  with  llu'  same  value  of  fi.  also  ealciilaled  the 
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Table  I.  Probability  of  Rejecting  Hypothesis  of  Exponentiulity  — ( 
(Null  hypulhmia  is  Hu:f{t)  = e ') 
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>imiilaic(l  |MPwer  wlit'ii  fi  = 5/4  and  10/7.  This  was  (lone  hfcausc  ii  givi-s  one  run  with  a mean  cIomt  In 
that  III  llic  null  (listiihutiiin  (namely.  0.951  vs.  I I.  a seeonil  with  a mean  hall  w a>  in  hetween  1.0  ami  1.5, 

ami  a ihinl  with  a mean  in  hetween  the  other  two.  Kiirtherimire.  lor  illustrative  |)ur|)nses.  hnth  mie  ami 

Iwci-siileil  tesl>  were  used;  mite  that  Kerehn  and  Kin”er  used  2.(KH)  [iiiint  ( iine->ideil I simulatiniis  as 
eiini|iared  tn  iiur  1 ,(KK). 

it  M’eins  therelnre  lair  to  say  that  the  current  results  are  quite  ennsi.steiil  with  the  earlier  nm"-.  W e 
can  he  sure  these  r 'suits  can  ail  he  impriived  hy  a mure  judieimis  .-eheme  hir  data  .••|ilittint;.  thuu”h  the 
mirmali/.ed  spaeinfi  appruaeh  with  r=  [n/2]  lend>  to  do  pretty  well. 

4.  SI'KCIALIZATIOIN  TO  L<M;  N0R!VIAI. 

The  luu  niirmal  alternative  turns  nut  tu  he  a very  -iiei  iai  ease,  since  the  r=  [ri'2]  ride  hir  data 

splittint;  is  estieeiallv  unwise.  \ carelul  luuh  at  the  pint  <il  a luu-mirmal  with  mean  I . |ui  example. 
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''2  dx 


gives  extremely  important  information  which  can  he  used  to  greatly  increase  the  power  of  the  F test. 
We  have  chosen  to  split  the  data  in  such  a way  that  the  numeratoi  of  the  statistic  is  based  on  the  first 
[n/4]  points  plus  the  last  [n/4],  while  the  denominator  is  calculated  from  the  remaining  points.  This 
simple  rule  increases  the  power  when  the  sample  size  is  .30  at  «=  0.05  from  0.032  to  0.553.  a very 
significant  improvement,  which  now  allows  the  F to  he  superior  lo.S*.  The  usual  ([n/2],  n — [n/2]) 
split  does  not  work  well  in  this  case  because  the  shape  of  the  hazard  tends  to  he  decreasing  for  the 
first  half  of  the  data  and  increasing  for  the  second  half  with  the  two  averages  working  out  to  he  very 
close  to  each  other.  Any  such  direct  use  of  information  regarding  the  shape  of  the  alternative's  hazard 
rate  can  always  be  used  as  an  easy  but  important  way  of  improving  the  F's  power. 


TabI.K  11.  Comparison  of  Results 


Tabi.C  hi.  Results  for  Lop-Normal 
With  Modified  Spacinp  Flan 
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lestiiig  aftainst  specific  alternatives,  the  F test  comes  out  with  the  l)est  net  performance.  Beyond  all 
the  pluses  already  mentioned,  such  as  the  handling  of  censoring,  there  is  the  further  advantage  of  ease 
of  computation  and  ready  availability  of  critical  points.  In  fact,  it  is  rather  easy  to  store  F critical  values 
for  all  possible  ()airs  of  degrees  of  freedom  using  one  of  many  numerical  approximation  procedures 
from  the  literature  (for  example,  see  [6]). 
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